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DISTRIBUTED COMMUNICATIONS NETWORK INCLUDING 
ONE OR MORE TELEPHONY COMMUNICATION DEVICES HAVING 
PROGRAMMABLE FUNCTIONALITY 

5 

PJELATED APPLICATION 
This application claims priority under 35 U.S.C. §11 9(e) to commonly-owned, co- 
pending U.S. provisional patent applications serial no. 60/161,144, entitled, 
"Communications Network Using Intelligent Telephones", filed October 26, 1999, and 
10 serial no, 60/190,61 3, entitled, "Method and Apparatus for Organizing Configuration 
Information for a Communications System" filed March 20, 2000, v/hich both are 
incorporated herein by reference in their entities. 

FIELD 

1 5 This application is directed to a communications network having mtelligent end 

points for placing telephone calls. In particular, this application relates to a data network 
including one or more telephony communication devices that provide and control one or 
more telephony applications. 

BACKGROUND 

20 For a typical telephony communications network, incliifllr.^ v/ireless and wire- 

based networks, the endpclnls of such a network are telephony conirnunication devices 
such as a telephone or a teleiDhony-enabled computer. 

A telephony cc aniunication device as used herein is a de vice capable of 
performing at least the following traditional telephony tasks: initiating the setting up of a 

25 telephone call by sending a signal onto a transmission medium cf commimications 
network, detecting and indicating (e.g., ringing, beeping or bliruung a light) that a 
telephone call is incoming, determining that a user has responded to a phone call (e.g., 
off-hook detection, a keypad entry, a keyboard entry or a mouse click), sending a signal 
indicating that the user has responded onto the transmission modiur/i, receiving dialing 

30 instoictions from a user (e.g., from a rotary dial, push buttons, voice activation, keyboard 
or mouse), sending a signal representing the dialing instructions on to the transmission 
medixam, transmitting ar.d xeceiving acoustic audio signals to 
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and from, respectively, a user, and transmitting and receiving media (e.g., audio data) on 
to the transmission medium of the network. 

As used herein, a "telephony function" is a function performed in association 
with a telephone call. A "telephony application" is an application that performs one or 
5 more telephony functions. Telephony functions may be divided into two categories: 

core telephony functions and feature telephony functions. Core telephony fiinctions may 
be divided into three categories: phone set management, call control and media 
processing. 

As used herein, "phone set management" refers to the control of low-level device 

10 interactions on a telephony communication device such as, for example, button presses, 
hook switch operations and lamp or light emitting diode (LED) operations. 

As used herein, "media processing" refers to the transmitting and receiving of 
media between a user of a telephony communication device and a transmission medium 
of a network on which the telephony communication device resides. 

*5 As used herein, "call control" refers to the controlling of setting up, maintaining 

and tearing down a telephone call. For a traditional telephony communication device, 
controlling a telephone call typically involves the use of a single call control protocol 
including peer*to-peer-type protocols such as, for example, the Sessions Initiation 
Protocol (SIP) or the H.323 protocol, or a master/slave-type protocol such as, for 

20 example, the Media Gateway Control Protocol (MGCP), the Megaco/H.248 protocol, or 
the Skinny Station protocol promulgated by Cisco Systems, Inc. 

The SIP protocol is defined in RFC 2543, SIP: Session Initiation Protocol by 
Internet Engineering Task Force (IETF) as of October 26, 1999. The H.323 protocol is 
described by the International Telecommunications Union in the ITU-TN 

25 Recommendation: H.323 Packet-Based Multi-Media Communications System, Geneva, 
Switzerland, February, 1998. The Megaco/H.248 protocol is defined by IETF RFC 2885 
and ITU H.248. The MGCP protocol is described in RFC 2705 as of October 1999. 

As used herein, a "feature telephony function" is a function performed in 
association with a telephone call, beyond or in enhancement of the core telephony 

30 functions provided by phone set management, media processing and call control. For 
example, traditional telephony feature functions include placing a call on hold, call 
forwarding, voice mail ftinctions, call waiting, conference calling, etc... As referred to 
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herein, a "feature telephony application" is an application that performs one or more 
feature telephony functions. 

Performing core telephony functions and feature telephony applications requires 
processing resources. In traditional telephony communications networks such as, for 
5 example. Public Switched Telephone Networks (PSTN), Private Branch Exchanges 
(PBX), or Central Office Exchange Services (Centrex), telephony communication 
devices rely on a server, switch, or other centralized processing entities as the processing 
resource to control and perform the bulk of the telephony functions associated with a 
telephone call. Thus, traditional telephony communications netv/orks typically have 
10 centralized processing reccurces. 

In typical traditional communications networks, to perform telephony functions, a 
telephony communication device receives instructions from one or more network 
resources such as a server or central switch, and operates based on those instructions. 
Typically, the network resource maintains state information associated with the 
15 telephony functions and decides how to respond to events associated with the^nctions. 

Traditional communications networks include analog lines for transmitting 
analog data, digital lines for transmitting digital data, or a combination of both analog 
and digital lines. Further, some of these networks may include high-speed backbone 
segments, for example, a backbone segment comprising a fiber optic cable. 
20 Further, traditional communications networks may include any of a variety of 

telephones including teieplicnes that include analog logic for performing telephony 
functions, digital logic for performing telephony functions or a combination of analog 
and digital logic. 

For a telephone connected to a digital line, the telephone must include logic for 
25 converting acoustic audio signals into digital audio data. As uced herein, a "digital 

telephony conununication device" is a telephony communication device that, in addition 
to the telephony tasks described above, converts acoustic audio signals into digital audio 
data, and transmits digital data, including digital audio data, onto data line. 

More recently, conimuni cations networks have begun using data networks to 
30 transmit voice data (e.g., Voice-over-IP data) and other data belv/een a caller and one or 
more recipients. Such oaiz networks include Local Area Networks (LANs), 
Metropolitan Area Networks (MANs) and Wide Area Networks (WANs) such as the 



BNSOOCID: <WO 0131900A2.I.> 



wo 01/31900 ' ' PCT/lJSOO/29576 

-4- 

Internet. Typically, these data networks are designed to transmit data in accordance with 
the Internet Protocol (IP). 

During a telephone call across one or more data networks, digital audio data from 
a digital telephony communication device on a data network may be transmitted to 
5 another digital communication telephony device network on the data network, or to 
gateways between the data network and other communications networks. 

Data networks typically are more distributed (i.e., less centralized) than 
traditional telephony communications networks, relying on one or more servers or other 
network resources for processing as opposed to a central switch. 

In data networks, one or more telephony functions and/or applications may be 
made available on a digital telephony communication device through hardware, 
sometimes in combination with software and/or firmware. Typically, after initial 
deployment (i.e., installation) of the communication device in the field, e.g., at a 
customer's premises, the available telephony functions are essentially fixed in nature. 

1 5 Sometimes, one or more of the telephony functions include one or more user-definable 
parameters that allow a user to define values, and thus have a limited role in 
progranmiing the telephony communication device. For example, user-definable 
parameters may include the type or volume of a ring, a user password, numbers to be 
dialed automatically at the press of a single button, etc. The telephony functions 

20 themselves, however, are "closed" (i.e., inaccessible) to a user of the telephony 

communicafion device and third party vendors such that the definition of the telephony 
functions may not be modified by the user or third party vendors. 

Typically, to change a telephony function on an installed digital telephony 
communication device, the vendor that controlled development of the telephony 

25 functions must provide new hardware or software, or upgrade the existing hardware or 
software.. Further, additional telephony applications may not be added to a telephony 
communication device after the telephony communication device has been installed in 
the field. 

The telephony capabilities of typical telephony communication devices are 
30 limited in several ways. First, many telephony communication devices today are not 
capable of controlling telephone calls in which they participate, and those devices that 
are capable of controlling a telephone call (e.g., some digital phones) are capable of 



BNSCXXJID: <WO 013ia)aA2J_> 



wo 01/31900 ' PCT/USOO/29576 

-5- 

controlling the telephone call using only a single call control protocol, for example, SIP 
orH.323. 

Second, many telephony communication devices perform telephony operations in 
response to instructions received from external communications network resources upon 
5 which telephony applications are being executed. Further, for tliose telephony 

communication devices upon which telephony applications are denned and upon which 
the telephony applications may be executed, after these telephony communication 
devices have been initially deployed in the field, no further telephony applications may 
be added to the telephony communication device. 

^0 Also, for such telephony communication devices, after these telephony 

communication devices have been deployed in the field, the telephony applications are 
closed to users and third party vendors such that the telephony applications are 
essentially fixed in nature, i.e., they may not be modified by users and third party 
vendors. ^. 

^5 The telephony capabilities of typical communications iictv/orks also are limited 

in several ways, due in part to the limitations of the telephony con;rnunication devices 
that reside on these communication networks. 

First, the processing resources of many communications networks are highly 
centralized such that relati vely few network resources provide telephony functionality for 

20 the entire communications network. Second, even for those communication networks 
that are more distributed and include one or more telephony corninunication devices that 
have telephony applications defined thereon and have the capability to execute such 
telephony applications, after a telephony communication device has been initially 
deployed, its telephony applications are not modifiable by a user or a third party vendor 

25 and additional telephony applications may not be added to the t elephony communication 
device. 

Consequently, the telephony functionality of a traditionai communications 
network is limited either by the telephony functionality provided by a centralized 
network reisource or the fixed telephony functionality available on the telephony 
30 communication devices of the network. These limitations impair the flexibility of a 
network user to expand or modify the telephony functionality of the user's telephony 
communication device, thereby limiting the scalability and flexibility of the 
communications network. 
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SUMMARY 

Accordingly, provided herein is a telephony communication device having an 
open telephony system architecture such that one or more telephony applications defined 
5 on the telephony communication device may be modified, after initial deployment in the 
field (e.g., on a customer premise), independently of a vendor that controlled 
development of the one or more telephony applications. 

Also, provided herein is a telephony communication device having an extensible 
telephony system architecture such that the telephony functionality defined thereon can 
be expanded by adding telephony applications to the telephony communication device. 

Also provided herein is a telephony communication device capable of controlling 
a connection during a telephone call using any of a plurality of call control protocols, 
including SIP, H.323, MGCP, Megaco/H.248, and the Skinny Station protocol. Further, 
for a telephone call involving multiple connections, for example, a conference call, the 
telephony communication device can control communications on each connection 
concurrently and can use a different call control protocol for each connection. 

Also provided herein is a communications network including one or more 
telephony communication devices having one or more of the following properties: an 
open telephony system architecture, an extensible telephony system architecture; the 
capability to control a telephony call using any of a plurality of call control protocols. 
Such a communications network has more flexible and scaleable telephony functionality 
than existing communication networks. 

In a first embodiment, provided is a first telephony communication device that is 
part of a communications network that includes a transmission medium. The first 
telephony communication device includes a telephony hardware component and a 
telephony software component. The telephony hardware component includes one or 
more inputs to receive audio input from a first user and first data from the transmission 
medium, and one or more inputs to transmit media to the first user and second data to the 
transmission medium. The telephony software component controls operation of the 
hardware component and includes at least a portion of a telephony application defining a 
telephony function to be performed in association with a telephone call. The telephony 
application is modifiable after the first telephony communication device is deployed on 
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the communications network \vitli modifications developed independently from creation 
of the telephony software component. 

In another embodiment, a method of defining functionality for a telephony 
communication device is provided, where the telephony communication device is part of 
5 a communications network that includes a transmission medium. The telephony 
communication device includes a telephony hardware component and a telephony 
software component. The telephony hardware component includes one or more inputs to 
receive audio input from a first user and first data from the transmission medium, and 
includes one or more outputs to transmit media to the first user and second data to the 

10 transmission medium. The telephony software component controls operation of the 

hardware component and includes at least a portion of a telephony application defining a 
telephony function to be perfomied in association with a telephone calL After the 
telephony communication device is deployed on the communications network, the 
telephony application is accessed on the telephony communication device, and modified 

15 with modifications developed independently from creation of the telephony software 
component. 

This embodiment may be implemented as a computer program product that 
includes a computer-readable medium and computer-readable signals stored on the 
computer-readable medium that define instructions. These instructions, as a result of 

20 being executed by a computer, instmct the computer to perform the acts described above 
for this embodiment. 

In yet another embodiment, provided is a system for defining functionality for 
telephony communication device that is part of a conununications network that includes 
a transmission medium. The telephony communication device includes a telephony 

25 hardware component and a telephony software component. The telephony hardware 
component includes one or more inputs to receive audio input from a first user and first 
data from the transmission medium, and includes one or more outputs to transmit media 
to the first user and second data to the transmission medium. The telephony software 
component controls operation of the hardware component and includes at least a portion 

30 of a telephony application defining a telephony function to be performed in association 
with a telephone call. The system includes means for accessing ihe telephony 
application on the telephony communication device after the telephony communication 
device is deployed on the com.munications network, and means for modifying the 
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telephony application with modifications developed independently from creation of the 
telephony software component. 

In another embodiment, a communication network is provided that includes a 
transmission medium and one or more telephony communication devices, where each 
5 telephony communication device comprises a telephony hardware component and a 
telephony software component. For each telephony communication device, the 
telephony hardware component includes one or more inputs to receive audio input from a 
first user and first data from the transmission medium, and one or more outputs to 
transmit media to the first user and second data to the transmission medium. The 

10 telephony software component controls operation of the hardware component and 

includes at least a portion of a telephony application defining a telephony fianction to be 
performed in association with a telephone call. The telephony application is modifiable 
after the telephony communication device is deployed on the communication network 
with modifications developed independently from creation of the telephony software 

15 component. 

In another embodiment, provided is a first telephony communication device that 
is part of a communications network that includes a transmission medium, where the first 
telephony communication device includes a telephony hardware component and a 
telephony software component. The telephony hardware component includes one or 

20 more inputs to receive audio input from a first user and first data from the transmission 
medium, and includes one or more outputs to transmit media to the first user and data to 
the transmission medium. The telephony software component controls operation of the 
hardware component and includes at least a portion of a telephony application defining a 
telephony fiinction to be performed in association with a telephone call. At least part of 

25 an additional telephony application can be added to the telephony software component 
after the first telephony communication device is deployed on the communications 
network. 

In yet another embodiment, ftmctionality is defined for a telephony 
communication device that is part of a communication network that includes a 
30 transmission medium, where the telephony communication device includes a telephony 
hardware component and a telephony software component. The telephony hardware 
component includes one or more inputs to receive audio input from a first user and first 
data from the transmission medium, and includes one or more outputs to transmit media 
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to the first user and second data to the transmission medium. The telephony software 
component controls operation of the hardware component and includes at least a portion 
of a telephony application defining a telephony function to be performed in association 
with a telephone call. After the telephony communication device is deployed on the 
5 communication network, the telephony software component may be accessed on the 
telephony communication device, and at least a part of an additional telephony 
application may be added to the telephony software component. 

This embodiment may be implemented as a computer program product that 
includes a computer-readable medium and computer-readable signals stored on the 

10. computer-readable medium that define instructions. These instructions, as a result of 
being executed by a computer, instruct the computer to perform the acts described above 
for this embodiment. 

In another embodiment, provided is a system for defining functionality for a 
telephony communication device that is part of a conununications network that includes 

15 a transmission medium, where the telephony communication device includes a telephony 
hardware component and a telephony software component. The telephony hardware 
component includes one or more inputs to receive audio input from a first user and first 
data firom the transmission medium, and includes one or more outputs to transmit media 
to the first user and second data to the transmission medium. The telephony software 

20 component controls operation of the hardware component and includes at least a portion 
of a telephony application dexlniug a telephony . function to be performed in association 
with a telephone call. This system includes means for accessing the telephony software 
component after the telephony communication device is deployed on the 
communications network, and means for adding at least a part of an additional telephony 

25 application to the telephony sofir^,'are component. 

In another embodiment, a communications network is provided that includes a 
transmission medium and one or m.ore telephony communication devices, where each 
telephony communication device includes a telephony hardware component and a 
telephony software component. For each telephony communication device, the 

30 telephony hardware component comprises one or more inputs to receive audio input 

from a first user and first data from the transmission medium, and includes one or more 
outputs to transmit media to the first user and second data to the transmission medium. 
The telephony software component controls operation of the. hardware component and 
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includes at least a portion of a telephony application defining a telephony function to be 
perfonmed in association with a telephone call. At least a part of an additional telephony 
application can be added to the telephony software component after the telephony 
communication device is deployed on the communications network. 
5 In yet another embodiment, provided is a first telephony communication device 

that is part of a communication network that includes a transmission medium, where the 
telephony, communication device includes a call processing module. The call processing 
module represents and controls at least a first telephone call that includes one or more 
connections to other users, where each user corresponds to another telephony 

10 communication device on the communications network. For at least a first of the one or 
more connections, the call processing modules operative to control communications on a 
telephony device corresponding to the first connection using a first call control protocol 
selectable from a plurality of call control protocols available on the first telephony 
communication device. 

1 5 In another embodiment, a first telephone call is controlled on a first telephony 

communication device that is connected to a communications network. The telephone 
call includes one or more connections to other users, where each user corresponds to 
another telephony communication device on the communications network. For at least a 
first of the one or more communications, a first call control protocol is selected from a 

20 plurality of call control protocols available on the first telephony communication device, 
and communications on the telephony, communication device corresponding to the first 
connection are controlled using the first call control protocol. 

This embodiment may be implemented as a computer program product that 
includes a computer-readable medium and computer-readable signals stored on the 

25 computer-readable medium that define instructions. These instructions, as a result of 

being executed by a computer, instruct the computer to perform the acts described above 
for this embodiment. 

In another embodiment, provided is a system for controlling a first telephone call 
on a first telephony communication device connected to a communications network. The 

30 telephone call includes one or more connections to other users, where each user 
corresponds to another telephony communication device on the communications 
network. For at least a first of the one or more connections, the system includes means 
for selecting a first call control protocol from a plurality of call control protocols 
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available on the first telephony communication device, and means for controlling 
conmiunications corresponding to the first connection on the telephony communication 
device using the first call control protocol. 

In yet another embodiment, a communications network is provided that includes 

5 a transmission medium and one or more telephony communication devices, where each 
telephony communication device includes a call processing module. For each telephony 
communication device, the call processing module represents and controls at least a first 
telephone call that includes one or more cormections to other users, where each user 
corresponds to another telephony communication device on the communications 

10 network. For at least a first of the one or more connections, the call processing module is 
operative to control communications corresponding to the first connection on the 
telephony communication device using a first call control protocol selectable fi-om a 
plurality of call control protocols available on the first telephony communication device. 
In another embodiment, a computer program product is provided that includes a 

15 computer-readable medium, and computer-readable signals stored on the computer- 
readable medium that define instructions that, as a result of being executed by . a 
telephony communication device, instruct the telephony communication device to 
perform a telephony application. At least a portion of the telephony application may be 
added to the telephony communication device after the telephony communication device 

20 has been deployed on a communications network. 

. In another embodimjent, a computer program product is provided that includes a 
computer-readable medium, and computer-readable signals stored on the computer- 
readable medium that define instmctions that, as a result of being executed by a 
telephony communication device, instruct the telephony communication device to 

25 perform a telephony application. At least a portion of the telephony application may be 
modified on the telephony communication device after the telephony commimication 
device has been deployed on a communications network with modifications developed 
independently from creation of the telephony application. 

The features and advantages of the invention described above and other features 

30 and advantages of tlie invention will be more readily understood and appreciated from 
the detailed description below, which should be read together with the accompanying 
drawing figures. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
In the drawings, 

Fig 1. is a block diagram illustrating an example embodiment of an open and 
extensible telephony system architecture for a telephony communication device; 
5 Fig. 2 is a block diagram illustrating an example embodiment of a core telephony 

functionality layer of the open and extensible telephony system architecture of Fig. 1 ; 

Fig. 3 is a data flow diagram illustrating an example embodiment of a media 
processing component corresponding to the media processing module of Fig. 2; 

Fig. 4 is a block diagram illustrating example embodiments of the call processing 
10 module of Fig. 2 and the media processing module of Fig. 2; 

Fig. 5 is a diagram illustrating an example embodiment of a telephony 
communication device; 

Fig. 6 is a diagram illustrating an example embodiment of a graphical display 
provided by a telephony communication device; 
15 Fig. 7 is a block diagram illustrating an example embodiment of a 

communications network including one or more telephony communication devices 
having modifiable and expandable functionality; 

Fig. 8 is a flowchart illustrating an example embodiment of a method of 
indicating an incoming call to a second user of a telephony communication device; 
20 Fig. 9 is a flowchart illustrating an example embodiment of a method of 

selectively transmitting media during a telephone call; 

Fig. 1 0 is a flowchart illustrating another example embodiment of a method of 
selectively transmitting media during a telephone call; 

Fig. 1 1 is a flowchart illustrating an example embodiment of a method of 
25 scheduluig and performing a telephone call; 

Fig. 12 is a flow chart illustrating an example method of displaying text 
associated with a telephone call; 

Fig. 13 is a flow chart illustrating an example embodiment of a method of 
communicating information in accordance with a state of a telephony communication 
30 device; 

Fig. 14 is a flow chart illustrating an example embodiment of a method of 
communicating information in accordance with a state of a telephony communication 
device; 
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Fig. 15 is a flow chart illustrating an example embodiment of a method of 
communicating an audible expression during a telephone call; 

Fig. 16 is a flow chart illustrating an example embodiment of a method of 
screening a telephone call based on information associated with the call; 
5 Fig. 17 is a flow chart illustrating an example embodiment of a method of playing 

content of an e-mail message as audio on a telephony commimication device; 

Fig. 18 is a flow chart illustrating an example embodiment of a method of 
sending a graphical message for a user to a telephony communication device; 

Fig. 19 is a flow chart illustrating an example embodiraent of a method of 
10 communicating a graphical message to a user of a telephony communication device; 

Fig, 20 is a fiOw chart illustrating an example embodiment of a method of placing 
one or more connections on hold during a telephone call; and 

Fig. 21 is a fiOW chart illustrating an example embodiment of a method of 
dynamically configuring a telephony communication device. 

15 
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DETAILED DESCRIPTION 
1. Telephony System Architecture 

A telephony system architecture is a system architecture including one or more 
inter-related system components that together define the available telephony applications 
5 on a Telephony Communication Device (TCD). An open telephony system architecture 
is a telephony system architecture that, in addition to a vendor that controlled 
development of the one or more telephony applications defined by the telephony system 
architecture, is accessible for users and third party vendors to modify the telephony 
functionality of one or more of the telephony applications after such telephony 

10 applications have been deployed in the field on a TCD. An extensible telephony system 
architecture is a system architecture that allows telephony applications to be added to a 
TCD already deployed in the field. 

Fig. 1 is a block diagram illustrating an example embodiment of an open and 
extensible telephony system architecture 1 for a TCD. The extensible telephony system 

15 architecture may be considered a layered architecture 1 where adjacent layers of 

abstraction (or layers) communicate between each other such that layers on either side of 
a given layer are independent of each other. In other words, functions may be defined 
for a higher layer of abstraction to be performed on a non-adjacent lower level of 
abstraction without knowing or specifying the details of the non-adjacent lower layer. 

20 For illustrative purposes, the TCD on which the telephony system architecture 1 

resides is referred to herein as a first TCD. This first TCD may be connected to a 
communications network, as will be described in more detail below in relation to Fig. 7. 

The open and extensible telephony system architecture 1 may include an 
applications layer 3, an open application programming interface layer 5, a core telephony 

25 functionality layer 9, an operating system layer 1 1, a software/hardware interface layer 
13 and a telephony hardware layer 15. 

1.1 Telephony Hardware Layer 

The telephony hardware layer or telephony hardware component 15 includes 
several hardware elements for performing the telephony operations associated with a 
30 telephone call. The telephony hardware component 1 5 may include a processor for 

processing instructions corresponding to a telephony operation. Such a processor may be 
chosen such that the processor is capable of processing a telephone call at a real-time rate 
such that a user participating in a telephone call does not experience any delays in the 
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telephony functions associated with the telephone call, particularly in the transmission of 
audio data. For example, the processor may be the StrongArm 1110 running at 206 
MegaHertz (MHz). 

The telephony hardware component 15 also may include memory for storing 
5 information. For example, the memory may include non-volatile memory such as a flash 
read-only memory (Flash ROM) for persistently storing telephony applications and data, 
and may also include volatile memory such as synchronous dynamic random-access 
memory (SDRAM) for temporary storage of and faster access to telephony applications 
and data. 

10 The capacities of the volatile memory and non-volatile memory may be selected 

and changed in accordance with the storage needs and configuration of the first TCD 
within the communications network. For example, the first TCD may be configured, as a 
part of being initialized, to download telephony applications and/or non-telephony 
applications from one or more storage resources on the network. In such a configuration, 

15 the first TCD may have a relatively larger amount of volatile memory for faster 

processing because a relatively lower amount of non-volatile memory is needed for 
storing applications. : 

In contrast, the first TCD may be configured to store large amounts of data such 
as, for example, audio files, or to stor^ one or more large applications or a large number 

20 of applications. In such a configuration, the first TCD may have a relatively larger 
amount of non-volatile memory to store the data and applications, resulting in less 
volatile memory. Obviously, the capacities of the volatile and non-volatile memories 
also are affected by the physical space available within the first TCD. 

The telephony hardware component 1 5 also may include audio processing 

25 circuitry for processing the audio information transmitted during a telephone call. The 
audio processing circuitry may include a codec for performing typical audio processing 
functions including the compression and decompression of audio data being transmitted 
to and received from, respectively, the communications network. The audio processing 
module may be designed to sample audio data in a variety of sizes and process the audio 

30 data at any of a variety of sample rates. For example, the audio processing module may 
include the UDA 1341TS stereo codec from Philips Semiconductors and sample audio 
data at a 16-bit size and at a sample rate of 32 kilohertz (KHz). Other sample rates may 
be used, such as, for example 44.1 and 48 KHz. 
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The telephony component 15 also may include video processing circuitry, 
including one or more video codecs, for processing video using known techniques. 

As will be discussed in more detail below in relation to Fig. 5, the telephony 
hardware component 15 also may include a display screen and associated graphical 
5 logic. In an embodiment, the display screen is a 160 x 1 60 pixels graphics display. The 
display screen may be capable of displaying color, monochrome, or gray-scale pixels. 
For example, in an embodiment, the display screen is designed to display pixels using a 
15-color gray-scale. 

The telephony hardware component 1 5 also may include a network interface for 
10 communicating data between the first TCD and the transmission medium of the 

conununications network. In an embodiment, the communications network adheres to 
the Ethernet protocol and the network interface is an Ethernet interface such as, for 
example, the CS 8900A-CQ3 lOBaseT Ethernet controller from Cirrus Logic. 

The telephony hardware component 15 also includes power circuitry for 
15 powering the first TCD. In an embodiment, the first telephony hardware component 1 5 
includes circuitry to receive power supplied by a Category 5 (Cat5) cable. The power 
supply circuitry may use powering approaches compatible with Cisco Inline-Power 
techniques for Cat5/Ethemet LANs developed by Cisco Systems, Inc. 

1.2 Software/Hardware Interface Layer 

20 The software/hardware interface layer 13 may define a plurality of drivers for 

operating the hardware elements of the telephony hardware layer 15. The drivers may be 
programmed in any of a plurality of programming languages, for example, C. 

1.3 Operating System Layer 

The operating system layer 1 1 may comprise any of the plurality of operating 
25 systems. As will be described below in more detail in relation to Fig. 2, the core 

telephony functionality layer is configured such that abstraction layers 1, 3, and 5 may be 
programmed independently of the operating system of the operating system layer 1 1. 

The operating system of the operation system layer 1 1 may he a real-time 
operating system (RTOS) or another operating system, such as, for example, Windows® 
30 NT, Mac® OS, UNIX® or LINUX®, which are more commonly associated with a general 
purpose computer. 
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In an embodiment of the operating system layer 1 1 that uses an RTOS, the RTOS 
may be VxWorks® from Wind River Systems, Inc. and the operating system layer 1 1 
may also include other components supplied by Wind River including: Personal 
J Works® 3.0 (Personal Java, JDK 1.1.6); True FFS Flash file system manager; the 
5 Simple Network Management Protocol (SNMP) vl/v2c; and the Rogue Wave tools.h-H- 
Library. 

1.4 Core Telephony Functionality Layer 

The core telephony functionality layer 9 defines the core telephony functions 
associated with a telephone call. Fig. 2 is a block diagram illustrating an example 
10 embodiment of the core telephony functionality layer 9, which includes an OS 

abstraction layer 33, the core telephony functions module 25, the telephony application 
objects module 23 and the core telephony functionality API module 21 . 

1.4.1 OS Abstraction Layer 

The OS abstraction layer 33 interfaces the native operating system of the 
15 operating system layer 1 1 with the remaining modules and layers of the telephony 
system architecture, including modules 21, 23 and 25 and layers 3, and 5. The OS 
abstraction layer 33, by providing an interface to the native operating system (e.g., 
Vx Works or Windows NT) avoids dependence on the native operating system by the 
remaining modules and layers. The OS abstraction layer 33 may include abstractions for 
20 maintaining date and time information, registering events, managing message queues, 
managing socket-based communications, synchronizing telephony operations on the 
TCD, managing tasks, and providing timers. 

1.4.2 Core Telephony Functionality Module 

The core telephony functions module 25 includes the phone set management 
25 module 27, the media processing module 29 and the call processing module 3 1 . The 
phone set management module 27 includes abstractions defined to handle low-level 
device interactions, such as button presses, hook switch operations, and lamp (LED) 
control. 

1.4.2.1 Media Processing Module 
30 The media processing module 29 provides a framework for the first TCD to 

perform real-time audio processing for one or more telephone calls. The media 
processing module 29 may be organized such that the media. data flows through with 
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minimum latency. The audio data may be processed in chunks, each chunk being audio 
data from a particular temporal interval. For example, the media processing module 29 
may process the audio data in 10 millisecond (ms) chunks. For example, as is described 
below in more detail in relation to Fig. 3, each processing element of a media processing 
5 component 30 may process media in 1 0 ms chunks. 

The media processing module 29 may include one or more media processing 
components, each media processing component corresponding to a particular telephone 
call. In a hardware embodiment, the media processing module 29 may include 
physically-separate media processing components such that the number of telephone 
calls that the media processing module can process concurrently is limited by the number 
of these physical media processing components. In such a hardware embodiment, at 
least part of the media processing module 29 may be implemented using a dedicated 
digital signal processor (DSP). 

In a software embodiment where an object-oriented programming language, for 
example. C++ or Java, is used, one or more abstractions (e.g., classes or stmcts) may be 
used to represent the media processing module 29 and one or more media processing 
components, as described below in more detail in relation to Fig. 4. 
1.4.2.1.1 Media Processing Component 

Fig. 3 is a data flow diagram illustrating an example embodiment of a media 
20 processing component 30. Traditionally, only audio has been associated with a 

telephone call. More recently, however, video has become a part of telephone calls. As 
described below in more detail, the first TCD may support telephone calls including 
audio, video and other associated data. Accordingly, although most of the media data 
and media processing elements described below are audio-related, the media processing ' 
component 30 also may include video processing elements that process video data in 
coordination with the audio processing elements of the processing component 30. 

The media processing component 30 may include one or more comiection media 
input interfaces 41 , a user media input interface 59, a local call bridge Sl , one or more 

connection media output interfaces 87 and a user media output interface 82. 

For a telephone call between one or more first users of the first TCD and one or 
more second users at one or more second TCDs, for each second TCD. the call 
processing module 31 (described in more detail below in relation to Fig. 4) maintains a 
corresponding connection to the second TCD. The media processing of the telephone 
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call is represented by the media processing component 30. Each connection media 
interface 41 and corresponding connection media output interface 87 together represent a 
connection between the first TCD and one of the second TCDs. 

Each network connection media input interface 41 includes an input buffer 42, a 
5 dejitter buffer 44 and a decoder 47. 

The input buffer 42 receives connection input media 40 and generates connection 
media 43. The connection input media 40 is media data received from the transmission 
medium of the network over a network connection from another telephone call 
participant, and may be received in the form of data packets confomiing to one or more 
1 0 media transport protocols, such as, for example, the Real-Time Transport Protocol (RTP) 
and the Real-Time Transport Control Protocol (RTCP), The input buffer 42 may de- 
package the connection input media 40 by removing the media transport information 
from the audio data packets of the connection input media 40 to produce the connection 
media 43. 

15 The connection input media 40 may be a chunk data from a temporal interval 

greater than the temporal interval, e.g. 10 ms, that the media processing component 30 is 
configured to process. Accordingly, the input buffer 42 may be configured to buffer the 
connection input media 40, process the input connection media 40 in chunks 
corresponding to the configured temporal interval, and output the connection media 43 in 

20 chunks corresponding to the configured temporal interval. Although not shown in Fig. 3, 
the other inputs, microphone audio data 55, tone indicator 57 and stored audio data 58, 
also may be received by input buffers and buffered such that the inputs received by the 
echo suppressor/cancelior 61, the tone generator 69 and the first mixer 74 are each a 
chunk of data corresponding to the configured temporal interval. 

25 The dejitter buffer 44 receives the connection media 43 and generates dejittered 

media 43. The dejitter buffer 44 applies know^ techniques to remove information from 
the connection media 43 to remove "jitter" from the resulting media played to a user of 
the first TCD. During transport across the network medium of the communications 
network, data packets of the connection input media 40 may have been routed and copied^ 

30 such that the connection input media 40 may include re-ordered packets and/or multiple 
same packets. For example, if ordered packets 1 , 2 and 3 were sent from a second TCD 
to the first TCD, packet 1 may be duplicated and the packets re-ordered such that packets 
1 , 3, 1 and 2 arrive at the first TCD. The dejitter buffer 44 of the TCD includes logic to 



BNSDOCia <WO___0131900A2J_> 



wo 01/31900 ' ' PCT/USOO/29576 

-20- 

recognize and eliminate re-ordered and duplicate packets such that the dejittered media 
45 includes the originally transmitted media packets 1, 2 and 3, properly ordered and 
without duplicates. 

The connection input media may have been encoded using known techniques by 
5 a second TCD before transmission to the first TCD. The decoder 47 receives the 
dejittered media 45, and decodes the dejittered media 45 using known techniques to 
produce decoded connection media 49, which is then sent to local caXl bridge 51. 

The user media input interface 59 includes an echo suppressor/canceller 61, a 
tone generator 69, a first mixer 74, a second mixer 65 and a splitter 73. 
*0 The echo suppressor/canceller 61 receives microphone audio data 55 and 

generates de-echoed audio data 63. The microphone audio data 55 is audio data received 
from the user of the TCD through a microphone. For example, the microphone audio 
data 55 may be received firom a microphone of a telephone handset, a microphone 
embedded in a telephone base as part of a speaker phone, or a microphone used for input 
15 to a computer. 

The echo suppressor/canceller may include echo suppression logic to control the 
suppression of echoes in the microphone audio data 55. For example, if a TCD has a 
speaker phone base assembly including a base speaker for playing audio signals of a 
telephone call, the echo suppressor/canceller 61 may include echo suppression logic to 

20 detect when the microphone audio data 55 includes voice data and to turn off the base 
speaker as a result of this detection. Accordingly, the microphone that a user is using 
during a telephone call does not receive any sound from the base speaker which would 
cause echoes of one or more voices of the telephone call to be included in the 
microphone audio data 55. 

25 The echo suppressor/canceller 61 also may include echo cancellation logic to 

apply echo cancellation techniques, by recognizing the lower intensity, delayed audio 
signals of an echo and to subtract these signals from the microphone audio data 55 to 
produce the de-echoed audio data 63. Other echo suppression and cancellation 
techniques miay be used. 

30 The tone generator 69 receives a tone indicator 57 and generates an indicated 

tone 71. The indicated tone 71 is a tone indicated by the tone indicator 57. For example, 
the tone indicator 57 may represent a digit of a telephone number entered by a user from 
a standard telephony touch tone dialing keypad, computer keyboard or mouse. In this 
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example, the indicated tone 71 generated by the tone generator 69 may be a tone 
associated with the digit in accordance with the Dual Tone Multi-Frequency (DTMF) 
standard. 

The tone indicator 57 also may represent other tones associated with a telephone 

5 call. For example, in response to a user lifting a handset from a switch hook or pressing 
a button on a telephone base, the tone indicator 57 may represent a dial tone to be 
generated by the tone generator 69. In response to attempting to establish a telephone 
call with another TCD that is busy, the tone indicator 57 may represent a busy signal and 
the tone generator 69 may generate, as the indicator tone 71, a corresponding busy 

10 signal. Further, in response to a call set-up message from anther TCD, the tone indicator 
57 may represent an incoming telephone call indicator, for example, a ring. Other tones 
associated with a telephone call may be generated by the tone generator 69. 

A first mixer 74 may receive the indicated tone 71 and Stored audio data 58. The 
stored audio data 58 may be a portion of an audio file or other form of audio data stored 

15 in an audio storage medium 60. For example, the audio data 58 may be streaming audio 
that is a portion of a voicemail message or a prerecorded sound. The audio storage 
medium 60 may be non-volatile memory on the TCD or another storage resource on the 
communications network on which the TCD resides. The stored audio data 58?may be 
sent to the first mixer 74 in accordance with a telephony application. 

20 The first mixer 74 may be configured with one or more of a plurality of mixing 

parameters 76. For example, one or more of the. mixing parameters 76 may indicate 
weights to be associated with the indicated tone 71 and the stored audio data 58. These 
weights may weigh the amplitudes of the indicated tone 71 and stored audio data 58 to 
generate the mixed audio 75. Accordingly, the mixing parameters 76 may effectively 

25 disable mixing of either the indicator tone 71 or the stored audio data 58, may give either 
input greater impact in generating mixed audio 75 or may be weighted such that the 
indicator tone 71 in the stored audio data 58 are mixed equally. 

The splitter 73 receives the mixed audio 75 and sends the mixed audio 75 to the 
second mixer 65 and a third mixer 83. 

30 The second mixer 65 receives the mixed audio 75 and the de-echoed audio data 

63 and mixes the two inputs to produce mixed user audio 67. This mixed user audio 67 
is sent to the local call bridge 51, which determines the media sent to each of the 
participants in the telephone call. Accordingly, the second mixer 65 may be configured 
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with one or more of the plurality of mixing parameters 76 to weigh the amplitudes of the 
mixed audio 75 and the de-echoed audio data 63, thereby defining the impacts of each of 
these inputs on the mixed user audio 67. 

The local call bridge 5 1 receives the mixed user audio 67 and one or more 
5 decoded connection media 49, each decoded network media 49 corresponding to a 
connection, and produces one or more connection mixed media 53 and a user-specific 
mixed media 81. The local call bridge 51 detemiines which of the decoded connection 
media 49 and the mixed user audio 67 to mix to produce the user-specific mixed media 
81 and each of the one or more connection mixed media 53. Further, the local call 
10 bridge 51 may receive bridge parameters 52 that configure the local call bridge 51 for 
such mixing. 

For example, the local call bridge 5 1 may be configured such that the user- 
specified mixed media 8 1 does not include some or all of the mixed user audio 67. Such 
a configuration prevents the user of the TCD from hearing the microphone audio data 55 

15 spoken by the user. This prevention may be desirable not only because the user may not 
need to hear her own voice, but also because hearing her own voice with a slight delay as 
part of the mixed audio output 85 may confiise the user, or at least make the mixed audio 
output more difficult to understand. 

Similarly, the local call bridge 51 may be configured to prevent each connection 

20 mixed media 53 corresponding to a first connection from including media of the 

connection input media 43 corresponding to the first network connection. For example, 
consider a conference call including participants Ul corresponding to the first TCD, a 
second user U2 corresponding to a second TCD and a third user U3 corresponding to a 
third TCD. The local bridge 51 receives a mixed user audio 67, Ml, corresponding to 

25 the first user and two decoded connection media 59, M2 and M3, corresponding to the 
first user Ul and the second user U2, respectively. The local bridge 51 may be 
configured to mix media Ml and media M3 to produce a connection mixed media 53, 
CI, to be transmitted to the second user U2. Analogously, the local call bridge 51 may 
be configured to mix media Ml and M2 to produce connection mixed media 53, C2, to 

30 be transmitted to the third user U3. 

Although some mixing configurations have been described above, the local call 
bridge 5 1 may be designed such that the bridge parameters 52 can configure the call 
bridge 5 1 to mix in any of a variety of ways. For example, as is described below in 
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relation to feature telephony applications, an application may define a particular mix, or 
a user may provide values through an application for one or more of the bridge 
parameters 52 that define a particular mix such that a particular combination of the 
mixed user audio 67 and the one or more decoded network media 49 may be mixed and 

5 prevented from being mixed in generating the user-specific mixed media 81 and/or the 
one or more connection mixed media 53. 

Each connection media output interface 87 may include an encoder 89 that 
receives the coimection mixed media 53 and encodes this media using known techniques 
to produce the encoded media 91 . An output buffer 97 receives the encoded media 91 

10 and configures the encoded media 91, for example, by adding transport protocol data 
(e.g., RTP and RTCP) to produce the connection output media 99. The connection 
output media 99 is transmitted to the TCD connected by the connection corresponding to 
the connection output media 99. 

The third mixer 83 receives the user-specific mixed media 81 and the mixed 

15 audio 67, and mixes these inputs to produce the mixed audio output 85. The mixed 
audio output 85 may be sent to any of a variety of audio output devices such as, for 
example, a speaker of a telephone handset of the first TCD or a base speaker on the base 
of first TCD. 

The recording buffer 93 may receive the mixed audio output 85 and store the 
20 mixed audio output to an audio storage medium 62 such as, for example, a non-volatile 
storage medium or another storage resource extemal to the first TCD, located on the 
communications network. The audio storage medium 62 and the audio storage medium 
60 may be a same storage medium or may each be part of a same storage medium. 
The third mixer 83 may be configured using one or more of the mixing 
25 parameters 76 to weight the amplitudes of the user-specific mixed media 81 and the 

mixed audio 75, thereby defining the impacts of each of these inputs on the mixed audio 
output 85. 

Each of the processing elements of the media processing module 29, including 
41, 42, 44, 47, 51, 59, 61, 65, 59, 73, 74, 82, 83, 89, 93 and 97, and data elements 
30 associated therewith, including 40, 43, 45, 49, 52, 53, 55, 57, 58, 63, 67, 71, 75, 76, 81, 
85, 91 and 99, may be represented using software, firmware, hardware, or any 
combination thereof. 
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In an example software embodiment, each processing element and associated 
data elements may be represented using a general purpose object-oriented programming 
language such as, for example, C-H- or Java. 

Fig. 4 is a block diagram illustrating in an example embodiment of the call 
5 processing module 3 1 of Fig. 2 in relation to an example software embodiment of the 
media processing module 29. In this software embodiment of the media processing 
module 29, the media processing component 30 is represented using an object-oriented 
programming language such as C++ or Java. 

The media processing module 29 may include a plurality of media processing 
10 controllers 1 1 5 and a plurality of media processing components 30, where each 
controller 1 15 and component 30 corresponds to a particular telephone call. 

The media processing component 30 includes a plurality of media processing 
abstractions 1 17, where each media processing abstraction 117 represents a processing 
element from Fig. 3 and the input and output data elements associated with the 
1 5 processing element. Each media processing abstraction 117 may be of a different type, 
where each type inherits from a master media processing abstraction. 

Each media processing abstraction 1 17 may include an attribute identifying the 
media processing component 30 to which the media processing abstraction ! 17 belongs 
and may include a plurality of methods that may be invoked on the media processing 
20 abstraction 1 1 7. The methods defined for one or more of the media processing 

abstractions 117 may include methods that do the following: enable and disable the 
media processing abstraction 117, initiate processing by the media processing abstraction 
117 of the chunk of media it received, determine one or more states of the media 
processing abstraction 117, determine the media processing component 30 to which the 
25 media processing abstraction 117 belongs, determine a name or unique identifier of the 
media processing abstraction 117, determine information regarding the data input and 
output from the media processing abstraction, determine a maximum and minimum 
number of inputs and outputs for the media processing abstraction 1 17, detennine the 
current number of inputs and outputs defined for the media processing abstraction, 
30 determine whether an input or an output is currently connected for the media processing 
abstraction 1 1 7, etc. 
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1.4.2.1.2 Media Processing Controller 

The media processing controller 1 15 controls the creation, operation and 
destruction of the media processing component 30. More specifically, the media 
processing controller 115 controls the creation of the media processing abstractions 117, 

5 the definition of the relationships between the media processing abstractions 1 17, the 
operation of the media processing abstractions 117, and the destruction of the media 
processing abstractions 117. 

For example, the media processing controller 115 may include methods for 
creating and destroying a media processing abstraction 117. The media processing 

10 controller 1 15 also may include a method for linking two media processing abstractions 
117 together, thereby defining that the output of a first media processing abstraction is 
the input of a second media processing abstraction. The media processing controller 114 
also may include a method for destroying such links, thereby destroying the relationship 
between two media processing abstractions. This adding and destroying of abstractions 

15 and links may be considered as building and removing, respectively, a media processing 
component 30 as part of setting up and tearing down, respectively, a telephone. call. 

Telephony applications of the applications layer 3, and other higher-level 
abstractions, may use the media processing controller 1 15 to dynamically create media 
processing components 30, and to link media processing elements during a telephone 

20 call. Further, a telephony application may be defined to configure media processing 

elements in unique ways to create custom media processing abstractions for a particular 
feature provided by the telephony application. 

The media processing controller 1 1 5 may include methods for enabling and 
disabling a media processing component 30. If there are currently multiple media 

25 processing components 30 representing multiple telephone calls, it may be desirable to 
disable a particular media processing component 30 when the telephone call that it 
represents is not active (e.g., on hold) such that media processing resources are 
conserved. Conversely, when a telephone call becomes active, the enabling method may 
be used to enable the corresponding processing component 30. 

30 The media processing controller i 1 5 may include a method for indicating when a 

media processing component 30 is ready for processing media, and also a method for 
indicating that the media processing component 30 is no longer needed and may be 
destroyed. 
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The media processing controller 115 may include methods for initiating 
processing of a next chunk of data by the media processing component 30, locating a 
media processing abstraction 1 17, determining a number of media processing 
abstractions 1 17 of the media processing component 30 and determining a number of 

5 links and a media processing component 30. 

As described above in relation to Fig. 3, a media processing component 30 may 
include representations of one or more connections. Accordingly, the media processing 
controller 115 may include an attribute corresponding to each connection represented by 
the media processing component 30. Further, the media processing component 30 also 

0 may include a method for retrieving a pointer to a connection. 

As described above in relation to the coimection media input interface 41 and the 
connection media output interface 87 of Fig. 3, media may be received and transmitted in 
the form of data packets conforming to one or more media transport protocols. 
Accordingly, the media processing module 29 may include an abstraction for 

5 representing a session, e.g., an RTF session, of one of the media transport protocols, and 
the media processing controller 115 may contain an attribute pointing to such attribute. 
Further, for each media processing abstraction 117 representing a connection of a 
telephone call, a media transport protocol such as, for example, RTCP, may maintain 
statistical information pertaining to the connection. The statistical information for the 

0 one or more connections may be aggregated and represented by an abstraction so as to 
monitor the transporting of the media on each connection. For example, this abstraction 
may be an RTCP session. The media processing controller 1 1 5 may contain an attribute 
that points to this RTCP session and may include a method for retrieving a pointer to the 
RTCP session.- 

5 For setting up a call between the first TCD and another TCD, the media 

processing controller 115 may include a method for determining one or more audio 
processing encoding algorithms supported by each TCD. As a result of this 
determination, the media processing controller 1 15 may control the decoding and 
encoding algorithms used by the decoder 47 and the encoder 89, respectively, of the 

0 media processing component 30. 

The media processing controller 115 also may include a method for creating a 
connection media processing abstraction 1 17 such as, for example, the connection media 
input interface 41 and the connection media output interface 87. 
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The media processing controller 115 also may include methods for controlling 
the starting and stopping of media input to the media processing component 29. For 
example, the media processing module 29 may include methods that perform one or 
more of the following functions: controlling the tone generator 69 to start or stop 
5 generating the indicated tone 71 ; controlling the connection input media interface 4 1 , in 
particular the input buffer 42, to start and stop generating the connection media 43; 
controlling the echo suppressor/cancellor 61 to start and stop receiving the microphone 
audio data 55; controlling the first mixer 74 to stop, start or pause receiving the stored 
audio data 58 to generate the mixed audio 75. 
10 The media processing controller 1 1 5 also may include methods for controlling 

media output from the media processing component 30. For example, the media 
processing component may include methods to perform the following functions: 
controlling the user media output interface to start and stop sending the mixed audio 
output 85 to audio output hardware and to start and stop storing the mixed audio output 
15 85 to an audio storage medium 62; and controlling the connection media output interface 
87, in particular the output buffer 97, to start and stop outputting connection output 
media 99 to the communications network. 

Although the first TCD currently may be involved in multiple telephone calls, the 
user of the first TCD can only actively participate in one telephone call at a time. For 
20 example, the user may have two telephone calls on hold, and be actively participating in 
a third telephone call. Because the user can only participate in one telephone call at a 
time, at any given time, only one media processing component 30 needs to use the one or 
more microphones and the one or more speakers of the first telephony communications 
device. Accordingly, the media processing controller 115 may include methods for 
25 assigning and de-assigning the microphones and speakers to a media processing 
component 30. 

All of the functions described in relation to the media processing controller 1 15 
and the media processing component 30 may be invoked in response to functions defined 
by higher-layer abstractions such as the telephony applications of the applications layer 
30 3. Specifically, these telephony applications communicate with the call processing 

module 31 to control the call processing associated with one or more telephone calls, and 
the call processing module 3 1 controls the media processing module 29 to process media 
in accordance with the one or more telephone calls. 
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Representing the media processing and call processing of a call independently, 
e.g.. with the call processing module 3 1 and the media processing 29. provides flexibility 
in designing the call processing module 31. For example, the media processing module 
may be implemented as part of a DSP or as one or more software abstractions. As a 
result, the call processing module 31 may be configured such that the abstractions of the 
call processing module 31 are generic to more than one implementation of the media 
processing module 29, such that less programming is needed to adapt the call processing 
module 31 to a particular implementation of the media processing module 29. 
1.4.2.2 Call Processing Module 

Fig. 4 shows the call processing module 31 of Fig. 2 in more detail. The call 
processing module 31 may model the state transitions of one or more telephone calls. 
Accordingly, applications running on the first TCD, for example, applications defined in 
the applications layer 3, may query the abstractions of the call processing module 3 1 to 
determine the state of a telephone call and its connections. Further, applications may 
register to be automatically notified if the state of a telephone call, including one of its 
cormections, changes, or if other telephony events occur. 

The call processing module 31.may include the following abstractions: a call 
manager 105, one or more calls 109. one or more call processing media interfaces 1 13, 
one or more call control connections 11 1, a call control transport controller 1 07, one or 
more call control network input interfaces 101 and one or more call control network 
output interfaces 103. 

The processing performed by the call processing module 31 includes controlling 
one or more calls in accordance with one or more call control protocols, (e.g., signaling 
protocols) and controlling the media processing associated with each call and the one or 
25 more connections included in the call. 

1.4.2.2.1 CallManager 

The call manager 1 05 may be considered the nucleus of the call processing 
module 3 1 and serves as an interface between the call processing module and higher 
layers of abstraction. The call manager 105 controls the one or more calls 109 that 
represent the telephone calls in which the first TCD is currently participating. The call 
manager 105 communicates telephony events to the appropriate call 109. Such events 
may include call control events, for example, a call control message, and applicalion- 
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level events, for example, an event indicating to create a new call 1 09 or connection or to 
terminate a connection or call. For example, during a telephone call, or in setting up or 
tearing down a telephone call, higher level telephony applications may invoke methods 
defined by the call memager 105, which, subsequently, may invoke a corresponding 

5 method of the appropriate call 109. 

Each call 1 09 may contain several methods, many of which correspond to the 
methods of the call manager 109, that are executed in accordance with the performance 
of a telephone call. It may be desirable to configure higher-level abstractions to 
communicate with the call manager 105, as opposed to an appropriate call 109, because 

10 calls 109 are relatively transient abstractions that rnay be available at one instance (e.g., 
during a telephone call) and gone at a next instance (e.g., after someone hangs up a 
telephone). Accordingly, the call manager 105 provides a less transient (i.e., more 
persistent) abstraction that is available regardless of whether the first TCD is currently 
participating in any telephony calls. 

15 Because the call manager 105 and each of the calls 109 that it manages include 

several analogous methods, it should be understood that, for illustrative purposes, several 
methods are described below in relation to the call manager 105 or a call 109, but such 
methods may be applicable to both types of abstractions in accordance with how the 
abstractions are configured. 

20 The call manager 105 may include several functions for controlling the setting 

up, maintaining, tearing down, and media processing of a telephone call. 

The call manager 1 05 may include an attribute that maintains a list of all calls 
109 currently represented by the call processing module 3 1, and may include methods 
for creating a call and dropping a call. For example, the call manager may create a call 

25 in response to a user dialing a number or entering a URL, or in response to the user 
answering a call by picking up a handset or pressing a button. 

The call manager 105 may drop a call in response to a user of the first TCD 
hanging up or in response to a signal received from another TCD indicating that the user 
of that device has terminated the telephone call. 

30 The call manager 105 may include a method for determining the number of calls 

109 currently represented by the call processing module 31, and for determining the call 
states of each of these calls 109. The call manager 105 and calls 109 define states that 
model a telephone call similar to how the Java Telephony Application Programming 
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Interface (JTAPI) models a telephone call. Accordingly, the states defined for a 
telephone call may include: the call state, such as, for example, idle, active or invalid; 
the terminal state which represents the state of the first TCD; the address state that 
represents the first TCD's address (i.e.. telephone number or URL); the call connection 
5 state that associates the first TCD's address with a telephone call; and the terminal 
connection state that associates the first TCD with a connection. 

The terminal connection may be desirable to define a state of a particular terminal 
connection because one or more TCDs may be associated with a same address. For 
example, a home may have a plurality of telephones reachable at a same telephone 
10 number. 

The call manager 105 may include a variety of methods commonly associated 
with a telephone call, including methods for adding a connection to a telephone call, 
dropping a telephone call, and transferring a telephone call to another TCD. Other 
methods may define, in response to receiving a call set-up message from another TCD, a 
15 function for accepting a connection with another TCD. Accepting a call may include 

invoking a function on the media processing interface 1 13 that controls the phone to ring. 
Further methods may define, in response to receiving a call set-up message, a fiinction 
for either rejecting a connection, including invoking methods of the media processing 
controller 1 15 to control generating a busy signal and sending it to the calling TCD, or 
20 re-directing the calling TCD to another TCD. 

The call manager 105 also may include a method for dropping a connection from 
a telephone call, for example, in jesponse to input from the user of the first TCD or in 
response to receiving a signal indicating that the user of another TCD has hung-up. 

The call manager 1 05 also may include methods for determining the number of 
25 call control comiections 11 1 of a call 109, for getting control of a call control connection 
1 1 1 , and determining a state of a call control connection 111. 

The call manager 105 also may include methods for determining addresses that 
have been called as part of a call 109 and for detemiining the addresses of the TCDs that 
have called the first TCD as part of the call 109. 
JO The call manager 105 also may include methods for completing the set-up of a 

connection between the first TCD and a second TCD, for example, by sending a 
response to a call control set-up message or by sending an acknowledgement to another 
TCD acknowledging that the other TCD accepted the invitation to have a telephone call. 



BNSDOCID: <WO 0131900A2J_> 



WO0i/3190() ' • PCTAJSOO/29576 

-31 - 

Such methods may communicate with the call control transport controller 107, described 
in more detail below. 

1.4.2.2.2 Media Processing Interface 

For each call 109, the media processing interface 1 13 provides an interface 
5 between the call 109 and the media processing controller 115 and media processing 
component 30 corresponding to the call 109. Through the media interface 1 13, a call 
109 may control its own media processing independently from the media processing of 
other calls 109. 

The media processing interface 113 may include several methods corresponding 

10 to the methods of the media processing controller 115. Further, the media processing 
interface 113 may include methods that control the media processing module 29 to 
process media in accordance witli a specific telephony event. As described above in 
relation to Fig. 4, the media processing controller 1 15 may include functions for 
controlling the tone generator 69 to start and stop the generating of indicated tones 71 , 

15 The media processing interface 1 13 may include functions to control the media 

processing controller 1 1 5 to control generation of a specific tone corresponding to a 
telephony event. For example, the media processing interface 113 may include functions 
for starting and stopping the playing of specific tones such as DTMF tones, dial tones, a 
tone indicating that another TCD is busy (e.g., a busy signal), and a tone indicating that a 

20 telephone call is incoming (e.g., a ring), etc. 

The media processing interface 1 13 may function as described in the following 
example. The call manager 105 may receive an indication, e.g., from the phone set 
management module 25, that a user h2is pressed a key on a telephone keypad. The call 
manager 105 determines the call 109 associated with the pressed key and invokes a 

25 method on the call 109 to play the DTMF tone associated with the key. Consequently, 
the call 109 invokes the appropriate method on the media processing interface 1 13 to 
start playing the DTMF tone, and this method invokes the appropriate method of the 
media processing controller 1 15 to control the tone generator 69 to receive the tone 
indicator 57, which indicates the DTMF tone, and to generate the DTMF tone as the 

30 indicated tone 7.1. 

The media processing interface 113 also may include one or more methods for 
querying the media processing module 29. For example, the media processing interface 
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1 1 3 may include methods for determining that the media processing module is receiving 
connection input media 40 and transmitting connection output media 99. 

The media processing interface 1 13 also may include methods for querying the 
phone set management module 25 regarding the status of low-level devices, such as the 
5 hook switch. For example, the media processing interface 1 13 may include one or more 
methods for querying one or more abstractions of the phone set management module 25 
to determine if a handset is ofF-hook. 

The media processing interface 1 13 also may include methods for determining 
the codec algorithms supported by the TCD. for assigning an audio output device to send 
the mixed audio output 85, and for determining whether an audio output device is 
currently enabled, for example, by querying the phone set management module 25. 

The media processing interface 113 may be any of a variety of types of media 
processing interfaces 113. For example, as part of the telephony system architecture 1 
residing on the first TCD, the media processing interface 1 13 is of a type defined 
specifically for a TCD. In another example, the call processing module 3 1 may model 
the call processing performed on a media gateway between two networks or a signaling 
gateway between different signaling protocols. In these cases, the media processing 
interface 1 13 may be of a type that is defined specifically for the type of processing 
necessary for the particular gateway. 

The media processing interface 113 deals primarily with processing media. 
Another aspect of the call processing module 31 is to control a telephone call, including 
the use of call control (i.e., signaling) protocols. This aspect of the call processing 
module 3 1 will now be described in more detail. 

1.4.2.2.2 Call Control Protocols 

A call 109 may be of a particular species of call, for example, a peer-to-peer (peer 
call) or a master/slave call (slave call). A peer call 109 represents a call that includes one 
or more connections adhering to a peer-to-peer protocol, for example, SIP or H.323, and 
may include one or more connections adhering to a master/slave protocol, for example. 
MGCP, Megaco/H.248 or Skinny Station. A slave call 109 represents a call that includes 
30 one or more connections adhering to a master/slave protocol. Each species of call 1 09 
includes abstractions for defining data corresponding to the type of connections included 
in thd call and for defining methods for controlling a telephone call in accordance with 
the species of protocol. 
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A slave call 109 is a call that is controlled by a network resource external to the 
first TCD. A slave call 109 may be one of a plurality of master/slave call types, 
including an MGCP call, a Megaco/H.248 call or a Skinny Station call. MGCP calls 
109, Megaco/H.248 calls 109 and Skinny Station calls 109 are calls that adhere to 

5 MGCP, Megaco/H.248, and the Skinny Station protocol, respectively. Each of these 
types of slave call may be defined as an abstraction that inherits from an abstraction of a 
generic slave call 1 09, and may further define functionality associated Vyith the type of 
slave call that it represents. 

The call processing module 31 includes one or more call control connections 111. 

10 Each call control connection 1 1 1 (except a ghost call connection described below in 

more detail) has a corresponding media control call connection as represented by a media 
processing abstraction 1 1 7 of the media processing module 29. As described above in 
relation to the media processing component 30, such media processing abstractions 
represent the media flow of the connection. In contrast, a call control connection 1 1 1 of 

15 a call 109 defines and controls the signaling communications on the first TCD that are 
associated with a call 109 in accordance with a particular call control protocol.' 

A slave call 109 may include a plurality of slave call control connections 1 1 1 that 
control the call signaling communications for the call on the first TCD in accordance 
with the type of master/slave call control protocol that the siave call control connection 

20 111 represents. 

For a peer call 1 09, each call control connection 1 1 1 may be one of several types, 
including an H.323 call control connection, a SIP call control connection, a ghost call 
control connection and a slave proxy call control connection. 

An H.323 call control connection and a SIP call control connection control the 

25 signaling communications of a connection on the first TCD in accordance vsnth the H.323 
protocol and the SIP protocol, respectively. 

A ghost call control connection represents a connection between two other TCDs. 
For example, if the first TCD transfers a call to another TCD and for some reason it is 
desired to track the progress of the transferred connection, a ghost call control connection 

30 may be used to monitor the state of the connection between the two other TCDs. To 
monitor the state of the transferred connection, the ghost call control connection may 
receive communications from one of the two other TCDs. Because the cormection is 
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between the two other TCDs. a ghost call control connection does not have a 
corresponding media processing connection. 

If a peer call 109 represents a call including a slave connector, a slave proxy call 
control connection 1 1 1 that proxies a slave call control connection 1 1 1 may be used to 
5 represent the slave connection HI. 

A telephone call represented by a call 109 may include several connections, each 
connection represented by a call control connection 1 1 1 . As described above, each 
connection included in the telephone call may adhere to any of a plurality of call control 
protocols. Accordingly, a call 1 09 may control one or more call control comiections 111, 
10 where each call control comiection 11 1 is of a different type, for example, an H.323 call ' 
control connection or a SIP call control connection. 

Representing each connection of a telephone call with an independeht call control 
comiection 1 11, and independently representing the media processing and call processing 
of a telephone call enables a call 109 including multiple comiections 111 to represent and 
15 control each connection concurrently, where each connection may adhere to any of a 
jjlurality of call control protocols. 

For example, during a telephone call between the first TCD. a second TCD and a 
third TCD, a first connection may exist between the first and second TCDs, and a second 
connection may exist between the first and third TCDs. The first connection may be 
20 represented by a SIP call control comiection 1 1 1, and the second connection may be 
represented by an H.323 call control comiection 111. Further, the fir^t and second 
comiections may be represented by independent media processing abstractions 1 1 7 that 
represent the media processing of the connection. 

The call 109 tHat represents such a telephone call may control the SIP and H.323 
25 call control comiections 1 1 1 and the corresponding media processing abstractions 1 1 7. 
During the telephone call, for each connection 1 1 l,in accordance with the call control 
protocol that the comiection represents. SIP or H.323, the call 109 may invoke methods 
of the media processing interface 113, which invokes methods of the media processing 
controller to control the processing of media on the appropriate comiections through the 
30 corresponding media processing abstractions 1 1 7. 

The call control comiections 1 1 1 control the signaling communications of a 
connection on the first TCD at a relatively high level. The call processing module 3 1 
also includes a call control transport controller 1 07 that controls the signaling 
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communications of a connection on the first TCD at a lower level that controls the 
transport and ensures the reliability of signaling messages transmitted from and received 
at the call processing module 31. 

The call processing module 3 1 also includes call control network input interface 

5 101 for receiving call control messages corresponding to a call control protocol, and a 
call control network output interface 103 that transmits call control messages from the 
call control transport controller 107 to the communications network. 

To send a call control message, for example, a SIP message, a call control 
connection 111 sends the message to the call control transport controller 107 which then 

10 sends the call control message to the call control network output interface 103, which 
then sends the call control message on to the communications network. 

For incoming call control messages, the call control netv/ork input interface 101 
receives the call control message and communicates the message to the call control 
trzmsport controller 1 07, which communicates the incoming call control message to the 

15 call manager 105. The call manager 105 then dispatches the call control message to the 
appropriate call 109 that includes the connection 1 1 1 representing the network 
connection from which the call control message was received. r 

The call control trcinsport controller 107 also notifies the call manager 105 of sent 
call control messages that have been sent on to the communications network, but for any 

20 of a variety of reasons failed to reach their destination. Further, in response to such a 
failure, the call control tmnsport controller 107 may re-send, a call control message onto 
the communications network through the call control network output interface 103. 

Using the various abstractions described above, the call processing module 3 1 
may be configured to support any of a plurality of call control protocols. Further, the 

25 call processing module 3 1 , or an application using the call processing module 3 1 , may be 
configured to select one of the plurality of call control protocols for a particular 
connection. This selection may depend on any of a number of factors, including 
available network resources and the capabilities of the TCD connected to the first TCD 
by the connection. 

30 For outgoing calls from the first TCD, the call processing module 3 1 or another 

telephony application may be configured to select a call control protocol to set-up a call 
with another TCD based on a sequence of digits or a URL entry by a user. For example, 
an application may define a rule indicating that, if a user enters a three-digit extension. 
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the H.323 protocol is used to control the telephone call. Further, an application may 
include a rule indicating that, if a user enters a ten-digit PSTN telephone number, then 
SIP is used to control the telephone call. 

In yet another example, an application may define a rule indicating that, if a user 
5 enters a URL including the character string "SIP", then the SIP protocol is used to 
control the telephone call, and if the user enters a URL including the character string 
"H.323", then the H.323 protocol is used. 

Significantly, because the details pertaining to different call control protocols are 
handled by the call processing module 31, the core telephony API layer 21 and open API 
layer 5, each described in more detail below, may be used to develop applications that 
are generic to all the call control protocols, allowing the call control details to be handled 
by the call processing module 3 1 . Thus, call processing module 3 1 allows API's of both 
the core telephony API layer 21 and open API layer 5 to be call-control-protocol- 
independent. 

Although the first TCD may be configured to support any number of call control 
protocols, and to select a particular call control protocol for a connection, the call 
processing module 3 1 , another module of the core telephony functionality layer 9, or one 
or more telephony applications of the applications layer 3 may configure the first TCD to 
support only certain call control protocols. For illustrative purposes, the various 
techniques that may be used to configure the first TCD to support particular call control 
protocols will be described with reference to the call processing module 3 1 , although 
other modules or layers may define applications to apply the same techniques. 

The call processing module 31 may be configured to determine the call control 
protocols supported by the conununications network on which the first TCD resides. For 
example, upon being initialized for the first time at a customer's premises, tlie call 
processing module 31 may send communications onto the customer's communication 
network to determine what call control protocols are supported, to determine any 
network resources that the first TCD should communicate with to implement the call 
control protocol, and to load any software necessary to support the call control protocol. 
Further, the call processing module 31 may be configured to determine which call 
comrol protocols are supported by the communications network for incoming and 
outgoing telephone calls. 
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The call processing module 31 may be configured to perform the discovering 
process in any of a number of ways, including: as a result of being initialized in the 
field, periodically, upon request by a user, or any combination thereof. Further, this . 
discovery process may be performed for the first TCD by another network resource, for 
5 example, a TCD deployment server, discussed below in more detail in connection to Fig. 
7. 

In an embodiment, the call processing module 31 is programmed to know the 
location of the one or more network resources that may be used for implementing one or 
more call control protocols. 

10 A communications network on which the first TCD resides may include a 

Dynamic Host Configuration Protocol (DHCP) server. The DHCP server may be 
configured to store information about the call control protocols that are supported by the 
communications network, and may indicate one or more servers that may be used to help 
implement the one or more call control protocols. If such a DHCP server is present, the 

15 call processing module 31 may access the DHCP server to retrieve the above-described 
call control information. Using DHCP servers to discover call control servers is 
described in the Internet draft document by the IETF entitled "DHCP Options for Call 
Control Servers" located at URI.: http://www.ietf.org/intemet-drafts/draft-ietf-^dhcp- 
OLtxt as of April 6, 2000. 

20 If the communications network does not include a DHCP server, or for some 

reason the DHCP server does not return the necessary call control protocol information, 
the call processing module 3 1 may be configured to communicate with one or more other 
network resources to determine the call control protocols, and their associated servers, 
supported by the communications network. 

25 For example, to determine whether the communications network supports the 

H.323 protocol, and the location of any H.323/SIP signaling gateways on the 
communications network, gatekeeper discovery techniques may be used. For example, 
the gatekeeper discovery techniques described by the International Telecommunications 
Union in the ITU-T Recommendation: H.323 Packet-Based Multi-Media 

30 Communications Systems, Geneva, Switzerland, February 1998. 

To determine if the communications network supports the SIP protocol, and the 
• location of any SIP servers on the communications network, the call processing module 
3 1 may be configured to locate the one or more SIP servers using SRV DNS records as 
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outlined in Appendix .f RFC 2543, SIP: Session Initiation Protocol by IETF as of 
October 26, 1999. If this SIP discovery technique fails, the call processing module 3 1 
may be configured to attempt to contact a SIP proxy server at sip.<local domain> at 
default port 5060, using UDP and/or TCP. 
5 To determine whether the communications network supports the MGCP protocol, 

and the location of any MGCP call agents, the call processing module 31 may be 
configured to use the SRV DNS records approach (analogous to the technique described 
above for SIP in RFC 2543). An MGCP call agent is an entity responsible for 
controlling telephone calls for a communications network using the MGCP protocol. 
The call processing module 3 1 may be configured such that, if this attempt to locate the 
MGCP call agent is unsuccessful, an attempt is made to contact an MGCP call agent at 
mgcp. <local domain> using UDP at the default port for MGCP, port 2427. 

To determine whether the communications network supports the Megaco/H.248 
protocol, the call processing module 3 1 may be configured to use a similar technique to 
that described above for the MGCP protocol. The Megaco/H.248 protocol standard is 
defined in IETF RFC 2885 and ITU H.248. 

The call processing module 31 may be configured such that if the 
communications network does not support a particular call control protocol, then a 
space-saving stub may be installed as the call control connection 1 11 for the particular 
20 call control protocol. 

The call processing module 31 may be configured to use a particular call control 
protocol, for example, SIP, as the call control protocol for all outgoing calls. If, 
however, the call processing module 31 determines that only a single call control 
protocol is supported by the communications network, the call processing module 31 
may assign this call control protocol as the protocol used for all outgoing calls. 

Further, if the call processing module 31 determines that the communications 
network supports multiple call control protocols for outgoing calls, but only a single call 
control protocol for inbound calls, the call processing module 31 may assign this single 
call control protocol as the call control protocol used for all outgoing calls. 

The call processing module 3 1 also may be configured to use a particular call 
control protocol as the call control protocol for all incoming calls. If, however, the call 
processing module 3 1 determines that only a single call control protocol is supported by 
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the communications network, call processing module 3 1 may assign this call control 
protocol as the protocol used for all incoming calls. 

Further, if the call processing module 31 determines that the communications 
network supports multiple call control protocols for incoming calls, but only a single call 
5 control protocol for outbound calls, the call processing module 3 1 may assign this single 
c£dl control protocol as the call control protocol for all incoming calls. 

By using abstractions 101-1 13, the call processing module 31 may be configured 
to support several features in accordance with a call control protocol e.g., SIP. Such call 
control features may include: transmitting and receiving call control messages in 
10 accordance with a variety of transport layer protocols, for exEimple, Transport Control 
Protocol (TCP) and User Data Protocol (UDP); basic call set-up functions such as 
sending a call set-up message and responding to a call set-up message; and firewall 
support. 

The call processing module 31 may support registering the first TCD in a registry 
15 or directory, for example, on a SIP server. Such a directory may reside on the/first TCD, 
or on another network resource, for example, a companion computer to the first TCD or 
a network server. As described in more detail below in relation to Fig. 7, each entry of 
such a server may map a name or a URL of a user to a network address of the first TCD. 

The call processing module 3 1 also may support having a registry entry 
20 corresponding to the first TCD expire after a predetermined ampunt of time. Further, the 
module 31 may be configured such that such. entry is refreshed periodically to avoid 
expiration of a user's entry while the TCD is active (i.e., powered on). 

The call processing module 3 1 also may be configured to initiate placing a 
telephone call on hold. For example, a signal may be sent from the first TCD to another 
25 TCD indicating that the first TCD will stop consuming bandwidth. Analogously, the call 
processing module 3 1 also may be configured to receive a message from another TCD 
indicating that the other TCD will stop consuming bandwidth (i.e., is placing the 
telephone call on hold). 

The call processing module 3 1 may be configured to redirect phone calls in a 
30 plurality of ways. For example, the call processing module 3 1 may be configured such 
that if the user of the first TCD is already participating in another phone call, an 
incoming telephone call is redirected to another device on the communications network. 
For example, the other device may be a voicemail server that plays the user's voicemail. 



BNSDOCID: <WO 0131800A2J_> 



25 



30 



WO 01/31900 . ' . . 

PCT/US00^9576 

-40- 

or may be another TCD. Further, user input, for example, from a button on a user 
.nterface may indicate that the user does not want to be disturbed regardless of whether 
the user ,s participating in a telephone call. Accordingly, an incoming call will be 
redirected automatically. Alternatively, an incoming call may be redirected if the 
5 mcoming call is not answered after a predetermined amount of time or after a 

predetennined number of rings. Lastly, an incoming call may be redirected on demand 
in response to' receiving a user input. 

The call processing module 31 may be configured to support blind transfers and 
consultative transfers of a telephone call. To perform a blind transfer, the call processing 
0 module 3 1 may be configured, for a telephone call between a first user of the first TCD 
and a second user of a second TCD, to instruct the second TCD to set-up a call with a 
third user of TCD. After instructing the second TCD, the first TCD will terminate the 
comiection between the first TCD and the second TCD without first consulting with a 
user of the third TCD. 

For a consultative transfer, the first TCD will set-up a connection to the third 
TCD. The first user may then consult with (i.e., talk to) a user of the third TCD after 
which the first TCD may instruct the second TCD to set-up a call with the third TCD or 
may instruct the third TCD to establish a connection with the second TCD. 

For either a blind transfer or a consultative transfer, an application may monitor 
the progress of establishing the new connection using a call 1 09 including a ghost call 
control connection 11 1. The other TCD that was instructed by the first TCD to set-up 
the new telephone call that includes the new connection may send one or more call 
control messages to the first TCD to notify the first TCD of the status of the new 
connection. If for some reason, it is desired to monitor and/or record the status of the 
new connection, the ghost call control connection 11 1 may maintain this status 
information. 

The call processing module 31 also may be configured to record routing 
information regarding one or more connections associated with the telephone call Such 
routing information may include the duration of a connection as part of a telephone call 
and this routing information may be used for several purposes including billing. 

The call processing module 3 1 , in accordance with the call control protocol of a 
connection, also may support attaching to a call control protocol message non-call 
control protocol information, for example, audio files, text files, applications, data files 
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and pointers to data files or applications, etc. For example, the call processing module 
3 1 may be configured such that multi-part MIMEs (Multi-purpose Internet Mail 
Extensions) may be attached to a SIP message. 

The call processing module 3 1 may be configured, in accordance with a call 
5 control protocol of a connection, to inform another TCD of the capabilities and/or 
additional features and functions supported by the first TCD. For example, the call 
processing module 3 1 may be configured to use fields of a SIP message to inform the 
other TCD of the capabilities and additional features of the first TCD, and may negotiate 
common capabilities to be used between the two TCDs. 

10 The call processing module 3 1 may be configured to record the duration of a 

connection between the first TCD and another TCD. Further, call processing module 31 
may be configured to send and/or receive a message to/from another TCD at pre- 
determined intervals to indicate that the sender of the message is still participating in the 
telephone call. Sending such messages at a pre-determined interval prevents an error in 

15 determining the duration of a phone call when a call control message to tear down a 
telephone call is never received. 

The call processing module 3 1 may be configured to support several different 
known methods of authentication, including basic and digest methods of authentication. 
Further, the call processing module 3 1 may be configured to provide different known 

20 authentication on the first TCD including symmetric authentication along with another 
TCD, and proxy authentication, where an authentication is performed for another 
network resource. 

Further, the call processing module 31 may be configured to re-invite a call 
participsmt back into a telephone call. Re-inviting may be desirable to change the 
25 encoding algorithm used for a connection in response to changes in available network 
bandwidth or in response to a change in the number of connections involved in a 
conference call. 

The call processing module 31 may be configured to combine two telephone calls 
into a single telephone call. For example, call manager 105 may manage a first 
30 telephone call 109 including a first SIP call control connection 1 1 1 and a first H.323 call 
connection 111, and a second telephony call 1 09, including a second SIP connection 111, 
where each call control connection 1 1 1 also has a corresponding media processing 
connection 117. To combine the two telephone calls, the call manager 105 may be 
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configured to create a third connection on the first call 109 that represents the second SIP 
connection 1 1 1 and to create a corresponding media processing connection 1 17 After 
transferring all the infomiation regarding the second call 109 and the second SIP 

connection in, the call manager 105 may then drop the second call 109. Asaresult the 
5 first call 109 remains, including two SIP call control connections 1 1 1. an H 323 call ' 
connection 1 1 1 and three media processing connections 117. 

Returning to Fig. 2, the phone set management module 27, the media processing 
module 29 and the call processing module 3 1 are relatively low level modules including 
abstractions that capture telephony events and notify other abstractions of these events 
10 The notified abstractions may be abstractions defined by one of the otl.er modules 27 29 
or 3 1 wuhrn the core telephone fimctions module 25, or may be abstractions from the' 
telephony application objects (TAO) module 23. 

1.4.3 Telephone Application Objects Module 

=5 "-yin^l-^ie" plurality of .elephonc application abst^Uons 
such as. for example, a client abstraction, a sender abstraction, a message abstraction a 
transport abstraction to enable local and remote communications between telephony ' 
applrcations defined in the appUcations layer 3 and the core telephony functions defined 
by the core telephony function module 25 and abstiactions corresponding to the 
telephony abstractions deflned by JTAPI. 
20 The TAO layer 23 may include logic enabling synchronous and asynchronous 

communicationsforhandlingrequest-responsecommandsandeventnotifications and 
abstractions defining interfaces to the core telephony functionality API layer 2 1 to' enable 
remote fimction calls on abstractions of the core telephony functionality layer 21 
Thus, the TAO layer 23 allows layers 1 5. 1 3, 11 , 33 and 25 to remain 
25 mdependent, logically and physically, from the remaining layers 21 5 and 3 

Accordingly, layers 21 , 5 and 3 may be embodied entirely within the first TCD may be 
embodied entirely on a network resource external to the first TCD and invoke remote 
function calls on the abstractions of the core telephony functionality layer 9 to develop 
and execute telephony applications or may be embodied partially within the TCD and 
30 partially external to the first TCD. 

The TAO layer 23 may be programmed in an object-oriented pmgramming 
language such as „r JAVA, and may include abstractions corresponding to .he 

abstractions defined by JTAPI. 
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1.4.4 Core Telephony Functionality API 

The core telephony functionality API 21 provides a programming interface to the 
core telephony functionality of the first TCD. The core telephony functionality API 21 
may include several abstractions corresponding to the abstractions provided by JTAPL 

5 For example, the core telephony functionality API 21 may include several abstractions 
written in C++ that were patterned after from the JAVA abstractions of JTAPL The core 
telephony functionality API 21 may be implemented using the Pingtel Telephony API 
(PTAPI) available from Pingtel Corporation of Woburn, Massachusetts. 

As described above, each abstraction of the core telephony functionality API 21 

10 may have a well-defined state and a set of events that are triggered as a result of state 
transitions. Analogously to JTAPI, the core abstractions of the core telephony 
functionality API layer 21 may include abstractions for: a provider, an address, a 
terminal call, a connection, a terminal connection, a terminal and listeners. The core 
telephony functionality API layer 2 1 may be configured such that only privileged 

15 vendors have access to, and thus may manipulate, the core telephony functionality of the 
first TCD. 

Telephony system architecture layers. 9-1 5 provide the first TCD with core 
telephony functionality and a programming interface for privileged vendors to 
manipulate this core telephony functionality and add additional functionality to it. Thus, 
20 if the first TCD were deployed in the field with just layers 9-1 5, the telephony 

functionality of the first TCD could be expanded or modified only by vendors having 
privileged access. 

Denying general access to certain core telephony functionality may be desirable 
so that the first TCD operates properly. For example, it may desirable to limit access to 

25 abstractions defined in the core telephony layer that controls structuring a call set-up 
message to be in conformity with a particular call control protocol, for example, SIP. 
Failure to limit such access may result in a user of third party vendor or user corrupting 
such abstractions such that the first TCD is incapable of sending messages onto the 
comrriunications network in conformance with the SIP protocol. 

30 On the other hand, it may be desirable to enable users and third party vendors to 

develop applications to be run on or in conjunction with the first TCD. Therefore, it may 
be desirable to have a telephony system architecture that is more open and extensible. 
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1.5 Open API Layer 

Accordingly, the telephony system a„:hitecture 1 may include layers 1-5 to allow 
the telephony functionality of the first TCD to be expanded and modified after bein^ 
deployed in the field. 

5 The open API layer 5 includes abstractions that are the building blocks for 

. applications developed for the application layer 3 by the API layer 5. For example the 
application open API layer 5 may include telephony framework classes written in tie 
JAVA programming language and may include a JAVA virtual machine (JVM®) from 
Sun Microsystems, Inc. 

The open API layer 5 provides open API3 for software developers to develop 
Wl.ca.ions, including telephony applications and non-telephony applications, for the 
applications layer 3. To make the open API layer 5 open to software developers the 
APIs of the open API layer, for example APIs 6. 7 and 8. and 10 may be distributed or 
made publicly available on the Internet. For example, one or more of APIs may be 
provded by the xprcssa Development Kit™ available from Pingtel Cotporation at 

http://wWW pmpfi^f r^r^^ 

The open API layer 5 may include one or more user interface APIs 6 one or 
more system APIs 7. one or more telephony APIs 8. and one or more media APIs io. 

1.5.1 User Interface API 

rr, '^T"^ ' " '"""'"^ "^'^'""'"^ ^ S^^Wcal user interface 

(GUI)forthefirstTCD. "n-euserinterfece API 6 may provide a plurality of controls 
and forms for designing the GUI. For example, the user interface API may be the JAVA 
abstract window tool kit (AWT, or the xpressa Window Toolkit™ (xWT). an extension 
of Java AWT, available from Pingtel Cotporation at htto://www nin^.i 

1.5.2 Telephony API 

The telephony API 8 provides a plurality of abstractions for adding functionality 
to and for manipulating the functionality of the first TCD. The telephony API 6 may be 
ITAPI from Sun Microsystems. Inc., or an implementation thereof The JTAPI 
specification is available at http://iava.sun com/^oductsteA Accordingly the 
telephohy API 6 may include a plurality of abstractions con-esponding to JTAPI 
mcluding abstractions for: an address of the first TCD, telephone calls in which'the first 
TCD ,s participating, connections included within these telephone calls, one or more 
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providers that provide telephony services corresponding to the first TGD, a terminal 
corresponding to the first TCD, etc. Other abstractions may include Observers, 
Listeners, Exceptions, events, states, methods associated therewith, or any other 
abstractions provided by JTAPI. 
5 Other telephony APIs 8 may include simplified versions of JTAPI for more 

streamlined and easier use. For example, the telephony APIs 6 may include the simple 
telephony API (STAPI) available firom Pingtel Corporation at http://www.pingtel .com . 

In addition to event abstractions and listener interfaces, the telephony APIs may 
include hooks that allow application developers to affect certain time-critical behaviors 

10 of the first TCD. A hook is a method, for example, a JAVA method, that is invoked by 
an abstraction if an event of a specified type occurs. For example, each of the telephony 
APIs 6-8 may provide hooks that allow a developer to affect the processing of caller-ID 
information, the redirecting or filtering of phone calls, and determining how the first 
TCD indicates to a user that a call is incoming. For exeimple, the first TCD msy indicate 

15 that a call is incoming visually, for example, by blinking a light, audibly, for example, by 
beeping, or by any combination thereof 

The open API layer 5 also may include a language interface to interface 
abstractions defined by the open API layer 5 with abstractions defined by the core 
telephony functionality layer 9, in particular, abstractions defined by the TAO module 

20 23. For example, if the one or more APIs of the open API layer 5 are defined in Java, 
and the TAO object module is defined in C^-t-, the language Interface may be the Java 
Native Interface (JNI). 

1.53 System API 

The system API 7 provides system-wide tools for the telephony system 
25 architecture 1, For example, the system API may include an application manager for 
starting, stopping, loading, unloading and monitoring applications running in the 
application layer 3. Further, the system API 7 may include an application arbitrator to 
regulate applications, prevent conflicts between applications, and to resolve conflicts 
between applications. The system API may provided as part of the xpressa Development 
30 Kit™. 

l,5.3.1 Application Manager 

The application manager may consist of a web server residing on the first TCD 
that enables the loading and unloading of applications onto the first TCD. Accordingly, 
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.he fi.,TCD,«,f.„,„„a„o,Ke.„ehv„Hc,«ou,ce such as a computer. Forexample as 
escnbed below i„ .,a,ion .o Fi«. 7. if fte firs, TCD is .™bodi«. as a .eiephone. 

"oinsulifte web browse, and oftertoois. on a computer .o provide an 
app„ca«p„s developer or ofter person access ,„ fte co.pu.er-s more extensive resources 
(e.g.. memory, video monitor, keyboard, mouse) to develop and upload applications 

To add an applioadon to tfte applicaSons layer 3 flrrough the application manager 
v«b server, a user may specify a location and file name. For example, through the web 
browser, the user may specify a URL a, which the executable file, for example a JAVA 
10 archive (.JAR) file, is located. ' example, a JAVA 

Depe«ling upon the configuraUon of the firs. TCD, the application manager web 
serv^may store the specified file on the first TCD itself, store the sp^ified file on 
a^er ne^rk resource and maintain a pointer to that location, or store a pointer to d,e 

URL specified by the user. 

S ■^ouni„s.allanapplication,ausermaymerelyentera,eapplicationname.h,ough 
•he web btowse, and the application manager web se„er will de-install the specified 

application, 

^^^^Pf-«---agern.aybei.pIe„,entedusingother^^^ 
besides a web-based client/server application. 

J 1.5.3.2 Application Arbitrator 

plications arbitrator may be configured to provide two general flmctions 
security and conflict resolution. 

The applications arbitrator may provide security for the fust TCD by regulating 
.he addttton, modificadon and execution of applications. For example, the application! 
arb..n»>r may require an applicafion being ins.alled, or modified and re-instal,ed. on the 
firs. TCD ,0 meet certain criteria. For example, the application may have ,„ register a 
hs. of first TCD resources. e.g.. absm^tions, that the application when executed is going 
use. The applications arbitrator may be configured to reject the application if the 
application does not include such a list. 

If U,e application does include a list, after inspecting the list, the applications 
arbttrator may reject the application, requiring the application .o be modified to no. use 
certam resources. Alternatively, the applications arbitrator may accept an application 
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and attach an indication of approval to the application, so that the application may be 
installed and executed on the first TCD. 

The application arbitrator may be configured to accept or reject applications 
automatically, or may provide a user interface to allow a user, e.g., a systems 
5 administrator, to review the list of resources for each application and manually accept or 
reject the application. 

The applications arbitrator also may be configured to monitor the application 
during execution. If the application uses a resource that it did not register with the 
application arbitrator, the application arbitrator may prevent the application from 
10 executing any further. 

The other general function provided by the applications arbitrator is conflict 
resolution. On typical communications networks, conflicts may occur between 
telephony functions running on the communications network. Historically, PBX-based 
telephony networks have tested for possible conflicts and worked to provide appropriate 
15 behavior if a conflict occurs. On a communications network having one or more TCDs 
with modifiable and expandable fiinctionality, however, each TCD may have a^ unique 
set of applications defined thereon and, consequently, a more diverse array of conflicts 
may occur. Therefore, it may be desirable to apply more proactive techniques for 
addressing these potential conflicts, including techniques to prevent conflicts between 
20 applications and techniques to identify and resolve conflicts if they do occur. 

Accordingly, the application arbitrator may be configured to resolve conflicts 
between two or more applications residing or being executed on the TCD. 

As discussed above, applications may communicate with abstractions of the core 
telephony functionality layer 9 to monitor telephony events. Specifically, applications 
25 may register to be notified 2is a result of an event occurring. To deal with conflicts 

between applications, first, for events for which two or more applications are registered 
to be notified, the application arbitrator may be configured to define an order in which 
the applications are to be notified. Second, the application arbitrator may be configured 
to define whether an application either a) handles and relays a telephony event, or b) 
30 consumes and does not relay a telephony event. 

If an application handles an event, after the application executes functionality in 
accordance with the occurrence of the event, the application then notifies the next 
registered application of the occurrence of the event. If an application is defined to 
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consume an event, then after the application executes functionality in accordance with 
the occurrence of the event, the application does not notify any further registered 
applications of the occurrence of the event. 

For example, a call waiting application may be configured to monitor a current 
5 call event defined by the call processing module 3 1 for any state changes, and may 

momtor incoming call events firom the network to determine if a new call is incoming If 
the state of the current call has not changed (i.e.. the telephone call is still ongoing) then 
If an mcommg call event occurs, the call waiting application may either (a) handle the 
event which triggers call waiting and also passes information about the new incoming 
-0 call to any other applications that have registered for such notification; or (b) consume 
the event, which triggers call waiting, but does not pass any information about the new 
call to any other applications, even those applications that are registered for automatic 
notification. For example, even though a call fonvarding application may be registered 
to be notified when an incoming call occurs, if the call forwarding application comes 
15 after the call waiting application, and the call waiting application is defined to consume 
the mcoming call event, then the call forward application will not be notified of the 
incoming call or receive any information regarding the incoming call. By preventing the 
call forwarding application from being notified about the mcoming call, a conflict 
between the call waiting application and the call forwarding application has been 
20 avoided. 

1.5.4 Media API 

Although the telephony API 8 enables a developer to develop a telephony 
application using well-defined relatively higher-level building blocks, e.g.. abstractions 
provided by JTAPI. it may be desirable to design a more-specialized media processing 
25 application using lower-level media processing building blocks. 

Accordingly, the media API 10 may provide tools to allow a developer to directly 
access and manipulate media abstractions of the media processing module 29, described 
in more detail above in relation to Figs. 3 and 4. A developer may develop a specialized 
media processing application to run on the first TCD by using the media API 10 to 
0 define custom media functions, for example, by invoking methods of the media 
processing controller 1 15 to link, create and destroy media processing elements 

For example, the media API 1 0 may be used to create and combine various media 
processmg elemems of the media processing module 29 to develop an application that 
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allows two or more participants in a conference call to conduct a side conference during 
the conference call, or an application that enables streaming audio conforming to a 
specific protocol, e.g., MP3, to be mixed into a telephone call, or an application 
implementing a customized voicemail system on the first TCD. 
5 Telephony applications of the applications layer 3, and other higher-level 

abstractions, may use the media processing controller 1 15 to dynamically create media 
processing components 30, and to link media processing elements during a telephone 
call. Further, a telephony application may be defined to configure media processing 
elements in unique ways to create custom media processing abstractions for a particular 
10 feature provided by the telephony application. 

2. Telephone Implementation of a Telephony Communication Device 

Fig. 5 is a diagram illustrating an example embodiment of the first TCD £is a 
telephone 200. The telephone 200 may be a desktop telephone having a connection to 
the network medium of the communications network. For example, the telephone 200 
15 may be a desktop LAN-connected telephone such as the Pingtel xpressa™ by Pingtel 

Corporation of Wobum, Massachusetts, and may have an ornamental design as-shown in 
U.S. Design Patent Application No. 29/120,479 entitled, "Telephone Base," by. James A. 
Batson, Jr. et al., filed March 20, 2000. i 

Alternatively, the first TCD may be implemented in a more compact form, for 
20 example, a battery-operated wireless telephone such as an analog mobile telephone, a 
Personal Communications Service (PCS) wireless telephone^ or a third generation (3G) 
wireless telephone. 

As shown in Fig. 5, the telephone 200 provides a user interface, including a 
telephone base 202 and a handsel 204. The telephone base 202 may include: a display 
25 screen 206; a scroll wheel 208; context-specific buttons 210; more button 212; dialing 
buttons 214; volume buttons 216; telephony fianction buttons 218; and speaker phone 
button 220 corresponding to base speaker/microphone 222, and visual indicator 224. 

The dialing buttons 24 may be used for dialing telephone numbers. 
Altematively, the telephone base 202 may include other interface controls, for example, 
30 a rotary dialer, for entering a telephone number. 

Each of the telephony function buttons 218 may be used to perfonn a specific 
telephony function, for example, activating/de-activating the handset, transferring a call, 
muting the microphone base, conference call, and placing a call on hold. Further, each 
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button 2 1 8 may have an associated visual indicator that is lit while the button is active. 
For example, for a hold button 218, an indicator associated with the button 218 may be 
lit if a call is on hold. 

The visual indicator 224 may be used to indicate one or more telephony events, 
5 for example, that a user of the telephone 200 has voice messages or that a call is 
incoming. Other visual indicators may be induced on the telephone 200. 

The display screen 206 may be a liquid crystal display (LCD) and may display 
data and other information supplied by an application. Further, the display screen 206 
may be designed with logic to be touch-sensitive such that selections and entries may be 
entered on the display screen 206 by touch. User interface controls 208. 210 and 212 
may be used to access the displayed data and information. 

The scroll wheel 208 may be integrated with the graphical user interface such that 
it may manipulate the position of information on the display screen 206, and may be 
used to select items displayed on the display screen 206. The scroll wheel 208 allows a 
user to interact with pages of content displayed on the display screen 206. A user may 
use the scroll wheel to change information displayed on the display screen 206 by 
scrolling or browsing down through the data, and then may select a specific item. 

One or more applications may configure the scroll wheel to be application- 
dependent. Such applications may provide multiple options for both the scrolling and 
selecting activities so that applications may be configured with a desirable combination 
of these activities. 

The direction in which the scroll wheel 28 is moved may determine forward or 
reverse progress through the content displayed on the display screen 206. For example, a 
clockwise rotation may cause forward movement through the content, and a counter 
clockwise rotation may cause reverse movement through the content, or vice versa. 

A detent is a device that checks motion. The scroll wheel 208 may use detents to 
provide feedback to the user. Each momentary stop that occurs while the scroll wheel is 
turned indicates that a new position has been reached. Optionally, the scroll wheel 208 
may be configured such that it may be turned continuously in either direction, each 
detent indicating a single forward or reverse movement, and the scrolling rate may be 
Stable from detent to detent. 

Alternatively, the scroll wheel 208 may be configured such that the extent to 
which the scroll wheel 28 may be turned is limited to a particular number, for example. 
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three, detent positions in each direction, and increasing resistance may be provided as the 
wheel is turned. Further, as a result of a user releasing the scroll wheel 208, it may 
automatically retum to a detent representing a rest position between the sets of 
directional detents. 

5 The scroll wheel 208 may be configured such that users may select a particular 

scroll rate using the detents, Altematively, scroll rates may be fixed or may be a 
combination of fixed and variable. Table 1 below illustrates various rate options for 
given scroll wheel positions with which the scroll wheel 208 may be configured. 



Scroll wheel position 


Fixed rate option 


Fixed and Variable rate 
option 


rest - l^t detent 


fixed, slow rate 


fixed, slow rate 


ist-2"d detent 


fixed, medium rate 


fixed, medium rate 


2nd _ 3rd detent 


fixed, fast rate 


accelerating, fast rate 



10 

Table 1 

For the combined fixed and variable rate option, an A-D converter may be used . 
to sense the scroll wheel position. 

The telephone 200 may be configured with a variety of GUI methods to selifect an 

1 5 item from the display screen 206. For example, the more button 212 may be configured 
to access advanced features such as menus, help and other applications. For example, 
the more button 212 may be configured such that, if it is pressed, the display screen 206 
may present tabs for listing and launching applications installed on the first TCD, getting 
context-specific help, and listing functions provided by an application.. 

20 On every page of content that is presented on the display screen 206 as the user 

scrolls, one item may be highlighted. Such an item may be highlighted by a visual cue, 
for example, reverse video or other visual highlighting, or by an indicator positioned next 
to the item such as an arrow or icon. 

Context-specific buttons 210 also may be provided. If an application is 

25 configured to use these buttons 2 1 0, then in accordance with the application, on each 

page of content displayed on the display screen 206 as the user scrolls, one or more items 
may be listed so that they align v/ith the context-specific buttons 210. Pressing a 
context-specific button 210 corresponding to an item selects the corresponding item and 
allows the application to proceed. Optionally, the item corresponding to the pressed 
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coatext-specific button 20 is selected for further application processing even if another 
Item is currently highlighted by a visual cue such as reverse video. 

Thus, the function of each button 210 depends on the content being displayed on 
the display screen 206. Specifically, each button 210 corresponds to an item of content 
5 bemg displayed at a particular location on the display screen 206. 

For example, referring to Fig. 6. the display screen 206 is displaying a list of 
applications. TT^e buttons 210 along the left and right-hand side of the display screen 
206 each correspond to a particular application item. If a user presses one of these 
buttons, the application corresponding to the button will be executed, which may result 
• m the display screen 206 now displaying new content specific to that application. 

The content-specific buttons 210 along the bottom of the display screen 206 may 
determine the body of content to be displayed on the display screen 206. For example in 
Fig. 6, each button 210 corresponds to a tab at the bottom of the display screen 206 
where each tab corresponds to a different body of content to be displayed. 

A first application may configure the display screen 206 such that if the content 
e.g., a list, to be displayed by a second application does not fit on the display screen a ' 
shder may indicate on the display screen 206 a position of the content being displayed 
relative to the entire content to be displayed by the second application. 

Figs. 5 and 6 illustrate example embodiments of a telephone and a user interface 
for implementing a TCD. These embodiments are for illustrative purposes, as several 
other embodiments of telephones having any of a variety of configurations may be used 
to unplement a TCD as described herein. 

3- Communications Network 

The communications network on which the first TCD resides may have any of a 
variety of configurations. For example, the communications network may include 
merely a network medium and two or more TCDs. Although the communications 
network is primarily described herein as being a wire-based network having wire (i e 
cable) as the network transmission medium, the communications network may be any of 
a variety of types of networks adhering to any of a variety of wireless protocols e g 
protocols for PCS networks, protocols for 30 networks or the wireless Ethernet protocol 
defined by IEEE 802.1 1, and having any of a variety of network transmission media 
such as carrier waves and fiber optic cables. Further, as is described below in relation to 
Fig. 7, the communications network may include a plurality of sub-networks or 
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segments, where each sub-network may include any of a plurality of transmission 
mediums. 

Fig. 7 is a block diagram illustrating an example embodiment of a 
communications network 300. The communications network 300 may include a network 

5 transmission medium of 332 and a plurality of TCDs including 302 and 306, The 

communications network 300 may be configured such that no other network resources 
are necessary to conduct a telephone call between two or more of the TCDs. For 
example, each TCD may be configured such that all of the telephony applications to be 
executed on the TCD reside completely on the TCD. Further, each TCD may be 

10 configured such that all of the data necessary to set-up a telephone call, including the 
network address of each participant of the telephone call, and any data necessary to 
execute any applications, also are stored entirely on the TCD. 

Altematively, the communications network 300 may be more distributed, 
including one or more other network resources to store data applications and parts of 

15 applications, and to assist in performing one or more telephony applications. 

Accordingly, the communications network 300 may include one or more 
companion devices, for example, companion devices 304 and 310, one or more directory 
databases, including directory database 308 and directory database 320, a TCD 
deployment server 314, one or more application servers 3 1 8, one or more call control 

20 servers 322, one or more network interfaces, for example, an IP/PSTN Gateway 326, and 
one or more management databases, for example, management database 316. 

The communications network 300 may be divided into a plurality of sub- 
networks or segments. For example, network elements 302, 304, 308 and 310 may 
reside on a network transmission medium 334 separated from network transmission 

25 medium 332 by one or more network interface elements 312. The one or more network 
interface elements 312 may be routers, bridges, switches, media gateways, microwave 
transmitters/receivers, cellular PCS network elements, or any combination thereof that 
control the transmission of data between network transmission mediums 334 and 332. 

For example, network elements 302, 304, 306, 308, 310 and 334 may be part of a 

30 customer network 340, and network elements 3 1 4, 3 1 8, 322, 326, 3 1 6, 320, 323 and 332 
may be part of a service provider network 324. 

The communications network 300 may include an IP/PSTN Gateway 326 for 
setting up a phone call between a TCD on the communications network 300, e.g., TCD 
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302, and a TCD on the PSTN, for example. TCD 334. Depending on the configuration 
of communications network 300. a different type of gateway may be used to 
communicate with TCD 334 on the PSTN. 

The IP/PSW Gateway 326 converts media and call control messages conforming 
> to one or more IP protocols and received from the communications network 300 to 
media and call control messages conforming to PSTN protocols to be sent onto the 
PSTN. Conversely, the IP/PSW gateway may be configured to also convert PSTN 
media and call control messages fi-om the PSIN into IP media and call control messages 
to be transmitted onto the communications network 300. 

As described above, a TCD 302 may be any of a plurality of devices including a 
telephone, for example, the telephone 200 of Fig. 5. or a computer. If the first TCD is a 
telephone, it may desirable to provide a companion device to provide additional 
resources for the telephone, including additional telephony functionality, data storage, 
and an environment for developing telephony applications. 

For example, at a user's home or office, a user may have a TCD embodied as a 
telephone for participating in telephone calls, and may have a general purpose computer 
for a variety of other tasks. Although the user's telephone may have more desirable 
ergonomic features for participating in the telephone call, the general purpose computer 
may have a plurality of features more desirable for developing applications and storing 
retrrevmg. and manipulating data. For example, a general purpose computer may include 
penpherals such as a video monitor, a keyboard and a mouse that the telephone 
embodiment of the TCD lacks. Further, the general purpose computer may have more 
extensive memory for storing data and applications and for rumiing applications 

To develop applications for a TCD. a companion device may include a plurality 
of APIs, including the APIs described above in relation to the open API layer 5 and the 
core telephony functionality API layer 21. To load these applications onto a TCD and 
unload applications from the TCD. a companion device may include an applications 
manager such as that described above in relation to the system API 7. 

A companion device also may be loaded with management software for 
managing various aspects of the communications network 300. For communicating and 
shanng data with other network resources, particularly TCDs, a companion device may 
be configured to communicate using a number of protocols, including the Simple 
Network Management Protocol (SNMP), the Hypenext Transport Protocol (HTTP) 
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Remote Method Invocation (RMI), the Hypertext Mark-up Language (HTML), and the 
File Transfer Protocol (FTP). 

The directory database 308 may store a variety of information about other users, 
TCDs, other network resources, or the communications network 300 itself Thus, a user 
5 may access this information to determine how to reach another user to set-up a telephone 
call. For example, the directory database 308 may store data for a commercial directory 
or phonebook product such as Microsoft Outlook® available from Microsoft Corporation 
or Lotus Notes® available from Lotus Development Corporation. These commercial 
software products may reside on the TCD itself or on a companion device to the TCD 
10 and may be configured to access the directory database 308 for information. 

Other directory databases, such as the directory database 320, may store data for 
one or more directory servers 323, as is described below in more detail. 

As described above in relation to Fig. 1 , one or more telephony applications may 
be stored and executed entirely on a TCD, one or more applications may be distributed 
15 such that at least part of the application is stored on another network resource, and one or 
more applications may be stored remotely from the TCD on another network resource, 
where the TCD maintains pointers to the remote applications. The one or more 
application servers 3 1 8 may serve as network resources that store one or more 
applications and parts of at least one or more applications. 
20 For example, an application server 318 may include a voicemail application or 

the server side of a client/server application, where the client side resides on one or more 
TCDs. Further, although a TCD may support conference bridging, as described above in 
relation to Figs. 3 and 4, if the number of connections involved in the conference call 
becomes too great, it may be more efficient to perform the conference bridging with a 
25 conference bridging application resident on an application server 318 that has more 
resources, or resources more dedicated to conference bridging. 

The communications network 300 may include one or more directory servers 323 
for directing calls between TCDs. Each directory server 323 may include a plurality of 
directories or indexes that map a user identifier such as a telephone number, logical name 
30 or extension name to a network address, for example, an IP address. This network 

address may be the network address of a TCD assigned to the user, or may be an address 
of another directory server that may store the network address of the TCD assigned to the 
user, or may be the network address of an IP/PSTN Gateway, for example, IP/PSTN 
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Gateway 326. One or more of these directories may be stored on the directory database 
320 that is accessible by the directory server 323. 

For example, a first network address directory may include a plurality of entries 
each entry corresponding to a telephone number, for example, 123-456-7890. Each entiy 
> may store a network address, for example, 10.20.30.40, corresponding to the telephone 
number. 

As a result of the first network address directory receiving a telephone number 
the first network address directory may lookup and access the entry in the directory 
server corresponding to the telephone number and retrieve the IP address contained 
therein. A first network address directory, as well as the second and third network 
address directories described below, may be configured to use this retrieved IP address 
m any of a variety of ways, as described in more detail below. 

The directory server 323 or the directory database 320 may also include a second 
network address directory, where each entry of thea second network address directory 
corresponds to a logical name, e.g., jsmith^acmexom of a user of the communications 
network 300. Each entry may store an IP address associated with the logical name 
Upon receiving a logical name, the directory server 323 may lookup and access the entry 
corresponding to the logical name and retrieve the IP address stored therein. 

The directory server 323 or directory database 320 also may include a third 
network address directory, where each entry corresponds to an extension, for example 
xI234@acme.com. Each entry may include an IP address associated with the extension 
Upon receiving an extension, the directory server 323 may look up and access the entry 
corresponding to the extension and retrieve the IP address stored therein. 

Although the network address directories have been described above as separate 
entrtres. any combination of these network address directories may be combined to form 
one or more directories. 

As described above, a TCD may store or have direct access to one or more 
network addresses corresponding to one or more TCDs, respectively. If a first TCD 
stores or has direct access to the network address of a second TCD. the first TCD may 
set-up a call with the second TCD directly by using a peer-to-peer protocol such as SIP 
or H.323. 

For example, TCD 302 may contact TCD 306 directly by sending a SIP set-up 
message to TCD 306, and TCD 306 may reply directly to TCD 302 to inform TCD 302 
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that it is willing to participate in the telephone call. Lastly, TCD 302 may send an 
acknowledgement message to TCD 306 to acknowledge that it received the response 
message from TCD 306. An analogous method may be applied to establish a telephone 
call between TCD 302 and TCD 334, except that the IP/PSTN Gateway 326 would serve 

5 as a network interface between conununications network 300 and the PSTN. 

Alternatively, TCD 302 may not store or have direct access to the network 
address of TCD 306. The TCD 302, however, may store or have direct access to other 
user identifiers of the TCD 306, for example, a telephone number, logical name or 
extension of TCD 306. Accordingly, the TCD 302 may communicate with a directory 

1 0 server 323 to determine the IP address corresponding to one or these indicators, as 
described above. 

If TCD 302 sends ihe user identifier to the directory server 323, the directory 
server 323 retrieves the network address corresponding to the TCD 306, depending upon 
the configuration of the directory server 323 and the TCD 302, the directory server 323 

15 may take any other plurality of actions. For example, if the directory server 323 is 

configured similar to a SIP proxy server, the directory server 323 may forward a call set- 
up message to TCD 306, which would respond to the directory server 323, which would 
then forward the response message to TCD 302. 

Alternatively, if the directory server 323 is configured similar to a SIP redirect 

20 server, the directory server 323 may send the determined network address back to TCD 
306, which would then send a call set-up message to the determined network address. 

As discussed above, however, each entry of a directory server 323 also may 
include an IP address of another network resource e.g., another directory server. The 
directory server 323 may be configured to send the received identifier to the other 

25 network resource to perform further look-ups to determine the network address of the 

user. If the network address retrieved is the network address of another directory server, 
and the directory server 323 is configured similar to a SIP proxy server, the directory 
server 323 may forward the call set-up message to the other directory server, and repeat 
the lookup process. Such communications between directory servers, and the lookups 

30 performed thereon, may be repeated until the network address of the user is determined. 
If the network address retrieved by the directory server 323 is the network 
address of another directory server, and the directory server 323 is configured similar to 
a SIP redirect server, the directory server 323 may send the retrieved network address to 
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the TCD 302. The TCD 302 then may access the other directory server, and repeat the 
lookup process. Such communications between directory servers and the TCD 302, and 
the corresponding lookup process, may be repeated until the network address of the user 
is determined. 

5 Further, an entry in the directory server may include multiple network addresses 

corresponding to a single identifier. For example, for a customer service telephone 
number, the customer service telephone number may map to a plurality of network 
addresses. Consequently, the directory server 323 may include logic to determine which 
network address to contact, and either send a call set-up message to the determined 
1 0 address, or send the determined address to the TCD 302. 

As described above, for telephone numbers corresponding to a TCD that reside 
on the PSTN, for example TCD 334, the directory server 323 may retrieve an IP address 
of an IP/PSTN Gateway, for example, the IP/PSTN Gateway 326. The network address 
retrieved by the directory server 323 may determine a network address of an IP/PSTN 
Gateway, for example, the network address of IP/PSTN Gateway 326 that is located 
most closely geographically to TCD 334. Depending on the configuration of the 
directory server 323, the directory server 323 may either forward a call set-up message to 
another network resource that wUI forward the message along to the appropriate 
IP/PSTN gateway, or may send the network address to the TCD 302 and allow the TCD 
20 302 to contact the appropriate IP/PSTN Gateway 326 on its own. 

If the TCD 302 is configured to use a master/slave call control protocol to set-up 
telephone calls, then, to set-up a telephone call, the TCD 302 may send a call set-up 
message to a master/slave controller 322. The master/slave control 322 then may set-up 
the telephone call using the durectory server 323 and directory database 320 using ' 
analogous techniques to those techniques described above with respect to a TCD 302 
configured to use a peer-to-peer protocol. 

Similarly, for telephone calls coming into the communications network 300, for 
example, by IP/PSTN Gateway 326 or by a network switching element such as a switch, 
router, bridge or hub, the directory server 323 may be contacted to determine a network 
address of a call recipient. For example, if TCD 334 attempts to set-up a call with TCD 
302, the IP/PSTN Gateway 326 will convert the set-up message to a set-up message 
conforming to a default call control protocol being used by the communications network 
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300. The IP/PSTN Gateway 326 will then forward the call set-up message including the 
user identifier to the directory server 323 to determine the network address of TCD 302. 

Several other techniques may be used to direct telephone calls to the appropriate 
user and TCD. 

5 A TCD that the TCD 302 is trying to set-up a call with may be configured to set- 

up calls using a call control protocol different than the call control protocol of the TCD 
302. For example, the TCD 302 may be configured to use the SIP protocol and TCD 306 
may be configured to use the H.323 protocol. Accordingly, the directory server 323 may 
be configured to determine the call control protocol that a network address supports and 
10 send this information to the TCD 302, or the TCD 302 may be configured to determine 
that a network address returned by the directory server 323 corresponds to a certain call 
control protocol. 

If the TCD 302 is configured to be able to communicate using the H323 
protocol, then TCD 302 may communicate with TCD 306 using the H.323 protocol. If, 

15 however, TCD 302 is not configured to set-up a telephone call using H.323, then TCD 
302 may send the SIP message to an H.323/SIP signaling gateway. The H.323/SIP . 
signaling gateway may convert the SIP message to an H.323 message. Accordingly, the 
H.323/SIP signaling gateway can send the generated H.323 message to TCD 306, and 
when TCD 306 responds with an H.323 message, the H.323/SIP signaling gateway may 

20 convert this H.323 message to a SIP message and send the SIP message to TCD 302. 

In an embodiment of the communications network 300, the network 300 may be 
configured to identify a call agent for each call that comes in to the network. For 
inbound calls, the associated call agent may be a SIP proxy server, an MGCP call agent, 
an H.323 gatekeeper, or an agent used by another call signaling protocol. 

25 As a number of TCDs 302 on the communications network 300 grows, it may be 

desirable to delegate telephony applications that may be provided by TCDs themselves 
to other network resources, for example, TCD deployment server 314. The TCD 
deployment server 312 may be configured with a plurality of telephony applications diat 
also may be configured on a TCD. The TCD deployment server 314 may include 

30 applications to configure and manage TCDs, perform software upgrades on TCDs, 

determine which applications should be installed on which TCDs, configure a plurality 
of TCDs into hierarchical groups that may have multiple tiers of hierarchy, for example: 
geographical region, metropolitan region, business division, business department. 
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building, floor, and group, down to a user. The TCD deployment server also may 
provide several other services to a TCD. 

The TCD deployment server 3 14 also may maintain personal TCD configuration 
information specific to a user of the communications netv^ork 300. Accordingly, 
regardless of where on the network a user uses a TCD, the user may indicate a unique 
Identifier to the TCD deployment server 314, and the TCD deployment server 3 14 may 
configure the TCD that the user is using according to the personal configuration 
information of the user. 

The TCD deployment server 314 may store the applications and data described 
above in a management database 3 1 6. The management database 3 1 6 may be any of a 
plurality of types of databases including an object-oriented database, a relational 
database, or a flat file database. Further, the TCD deployment server 314 may be 
configured to access the management database 316 using a pluraUty of techniques, 
including Open DataBase Connectivity (ODBC) techniques or Java DataBase 
Comiectivity (JDBC) techniques. Further, to communicate with other network resources, 
including one or more TCDs and companion devices, the TCD deployment server 314 
may be configured to communicate using a number of protocols, including SNMP 
HTTP, RMI, HTML, and FTP. 

The communications network 300 may be configured in any of a variety of ways, 
and the configuration of Fig. 7 is provided for illustrative purposes only. Several other ' 
network configurations may be used. 
4. Telephony Applications 

As described above, the open and extensible telephony system architecture 1 
provides the abUity to develop applications using the core telephony functionality layer 9 
and the open API layer 5, respectively. Accordingly, the plurality of applications now 
described may be implemented using the open API layer 5, the core telephony 
fiinctionality layer 9 or any combination thereof. Further, such applications may be run 
on one or more TCDs, one or more other network resources, or a combination thereof. 

Several of the applications described below define sending/receiving infonnation. 
including media, e.g., audio or video, textual data, instructions, or other information 
to/from one or more TCDs either during a telephone call or to set-up a telephone call. 
The information that is sent/received may depend on a state of the first TCD or the other 
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TCDs. Further, the action taken by a TCD as a result of receiving this information may 
depend on a state of the receiving TCD. 

Further, each of the applications defined below may be configured such that the 
application may be added to the first TCD or modified after the first TCD has been 
5 deployed on the communications network, for example, by using one or more APIs of 
the open API layer 5, as described above. 

Further each of the applications described below may be embodied as computer 
signals on any of a variety of computer-readable mediums, for example, a readable and 
writeable nonvolatile recording medium, such as a disk, a flash memory, a memory stick, 
10 a PC Card or a tape. Such a disk may be removable, for example, a floppy disk or a 
read/write CD, or permanent, known as a hard drive. 

Accordingly, the applications described below may access one or more 
abstractions of the core telephony functionality layer 9 to determine a state of a TCD or a 
telephone call on the TCD, and may control one or more media processing elements of 
15 the media processing component 30, described above, to process media in accordance 
with the application. i- 

A first telephony application may be configured to permit a caller from a TCD to 
have control over the sound that plays on the callee*s TCD to indicate an incoming call 
from the caller. The sound may be played from an audio file accessible by the callee, for 
20 example, an audio file stored on audio storage medium 60, may be coded within the tone 
generator 69 of the callee*s TCD, or the sound itself may be sent from the caller's TCD 
to the callee's TCD. The sound may be a ring, a voice announcement, or any sound that 
will be meaningful to the person being called. The sound may play intermittently until 
canceled by the callee, and may be broadcast over multiple TCDs on the 
25 communications network, for example multiple customer service TCDs. Such an 
application also may be used by the caller to "page" another TCD, but not set-up an 
actual telephone call. 

The sound to be played may be pre-recorded, for example, by capturing the sound 
through the phone mouthpiece or through a direct electrical audio signal capture jack on 
30 the phone, and then storing the sound on the TCD itself or on an accessible network 

resource. Both the callee's and caller's TCD may be configured to control the manner by 
which the sound is played, for example, by a programmer of the telephony application or 
by the caller or callee through user parameters provided by the telephony application. 



BNSDOCID: <WO 0131900A2J_> 



20 



25 



30 



WOOJ/31900 . ' . ' . , 

PCT/USOO/29576 

-62- 

Fig. 8 is a flowchart illustrating an example embodiment of a method of 
md.cating an incoming call to at least a second user of a second TCD. Such a method 
may be defined by one or more telephony applications. 

In Act 452, a dialing instruction corresponding to a network address of the 
5 second TCD is received. Next, in Act 454. the first user is identified from a dialing 
instruction, and in Act 456. a sound to be played is selected based on the identification 

In a following Act 458, a call set-up message is sent to the second TCD at the 
network address. The call set-up message includes information to cause the second TCD 
to produce the selected sound. The information included in the call set-up message may 
' mclude information representing the selected sound or instructions to play the selected 
sound. Further, the information may include a location from which to play the selected 
sound, for example, a URL. 

Another telephony application may enable multiple audio inputs received during 
a conference call between TCDs to be selectively mixed or muted, as described above in 
relation to the local call bridge 51 ofFig.3. Accordingly, a user of the first TCD 
particpating in a conference call may selectively mute or enable the audio streams of 
other conference call participants. Further, such an application may be configured to 
permit a user on a second TCD that is not controlling the conference call to send a 
communication to the first TCD instructing the first TCD to selectively mix audio 
received from and/or sent to the second TCD. As a result, amiouncements can be made 
to a selected subset of participants and questions directed to another subset, or the 
comments of specific individuals screened out of the conference temporarily. 

Although selectively mixing and muting audio signals has been described herein 
pnmarily in comiection to bridged conference calls, similar techniques may be used to 
selectively mix and mute audio for ftilly-meshed conference calls, where each TCD 
maintains a representation of every connection included in the conference call. Although 
such a fiiUy-meshed conferencing configuration reduces the load on a single TCD (i e 
the TCD that would otherwise provide the bridging), this configuration creates more ' 
network connections thus increasing network traffic and also makes controlling the 
conference call more complicated as now multiple TCDs are involved. 

T^urther. to implement selective muting and mixing during a telephone call, one or 
more specialized versions of a TCD may be provided, each containing extra signal 
processing power for mixing/muting. 
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Fig. 9 is a flowchart illustrating an example embodiment of a method 460 of 
selectively transmitting media during a conference call including a first user input for 
receiving media from the first user and two or more connections between the first TCD 
and two or more second TCDs, respectively. Each second TCD corresponds to a second 
5 user. Such a method may be defined by one or more telephony applications. 

In Act 462, a user selection is received that identifies one or more third users to 
include in receiving media from one or more fourth users. Each third user and fourth 
user is either the first user or one of the second users. 

In a next Act 464, during the conference call, one or more media inputs are 
10 received ft-om one or more of the fourth users. In a following Act 466, during the 
conference call, the one or more third users are permitted to receive media produced 
from the one or more media inputs. 

Fig. 10 is a flowchart illustrating another example embodiment of a method 470 
of selectively transmitting media during a conference call that includes a first user input 
15 for receiving media from the first user and two or more connections between the first 
TCD and two or more second TCDs, respectively. Each second TCD corresponds to a 
second user. Such a method may be defined by one or more telephony applications. 

In Act 472, a user selection is received that identifies one or more third users to 
exclude from receiving media ft-om one or more fourth users. Each third and fourth user 
20 is either the first user or one of the second users. . 

In a next Act 474, during the conference call, one or more media inputs are 
received fi-om one or more of the fourth users. In a following Act 476, during the 
conference call, the one or more third users are prevented from receiving any media 
produced from the one or more media inputs. 
25 In both methods 460 and 470, the media produced from the one or more media 

inputs may be media mixed in any of the variety of ways described above. Further, for 
both methods 460 and 470, the one or more third users may be permitted or prevented 
firbm, respectively, receiving media by using the local call bridge 51 of Fig. 3 as 
described above. Also, for both methods 460 and 470, the received user selection may 
30 be received from the first user of the first TCD or from one of the second users. 

Another telephony application may define a method of communicating, as part of 
a telephone call, textual information from a first user of the first TCD to a second user of 
a second TCD connected to the first TCD by a first comiection. Specifically, during the 
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telephone call, textual data defining text may be received on the first connection from the 
second TCD. The first TCD may then display the text defined by the textual data, for 
example, on display screen 206 of Fig. 5 described above. Such textual data may be any 
of a variety of data, for example, information about the second TCD or a user of the 
5 second TCD. 

A scheduling application may be defined to allow a user to schedule a telephone 
call, for example, a conference call. Using a user interface as described above in relation 
to Figs. 5 and 6. or another network resource such as a companion device 304 of Fig. 7 
described above, a user can schedule a telephone call by inputting telephone numbers of 
each of the telephone call participants and the date and time of the call. Further, if a 
remote conference bridge, i.e.. not the local call bridge 51, is be used to perform the 
telephone call, the user may configure the scheduling application to call the remote 
conference bridge to set-up the conference cal 1 . 

Such a scheduling application may interface with and access data from a database 
such as that provided by Microsoft Outlook® or Lotus Notes®, and may be configured 
to use the Internet Calendar and Scheduling Protocol (ICalendar) for communicating 
between the first TCD and any other TCDs or network resources involved in scheduling 
the conference call. 

Such a scheduling application may be configured such that after all the telephone 
call information, including the identifications of the participants and the date and time of 
the call, has been entered, the application automatically notifies the other participants 
about the scheduled call. This notification may provide a variety of information to the 
other participants, includmg the date and time of the call, and the identities and 
information regarding the other call participants. 

The scheduling application may be configured to notify the other participants in 
the telephone call by sending an electronic mail (email) message, for example, an e-mail 
message conforming to the Simple Mail Transfer Protocol (SMTP). 

Fig. 1 1 is a flowchart illustrating an example embodiment of a method 480 of 
scheduling and performing a telephone call between a first user of the first TCD and one 
or more second users of second TCDs. In Act 482, one or more user identifiers are 
received, where each user identifier identifies one of the second users. Such a method 
may be defined by one or more telephony applications. 
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In a next Act 484, date and time information is received that specifies a future 
date and time to conduct the call, and in Act 486, the user identifiers and date and time 
information may be stored. The identifiers and date and time information may be stored 
locally on the first TCD or on a remote network resource accessible by the first TCD. 
5 In a following Act 488, at the date and time specified by the date and time 

information, the user identifiers are accessed. Next, in Act 490, a telephone call may be 
initiated between the first TCD and the one or more second TCDs. 

Method 480 also may include acts of receiving a conference bridge identifier 
identifying a conference bridge, wherein the act of initiating the conference call includes 
10 calling the conference bridge. Further, the method 480 may include notifying the one or 
more second users about the call before initiating the telephone call by sending a 
message including information about the call from the first TCD to the one or more 
second TCDs. 

• A web-based dialing application may provide web-based dialing by defining a 

15 web server embedded within the first TCD to set-up telephone calls. The web^based 
dialing application may be configured to allow a user to create a web page on the 
embedded web server that includes links to the URLs that represent one or more 
participants to include in a telephone call. A link may include a variety of information 
about a telephone call, including an identifier, e.g., a telephone number, for each 

20 participant and an identifier of a conference bridge. 

Using a web browser application on the PC or other network resource, a user may 
access the web page on the first TCD and click on one or more URL links to cause the 
TCD to dial the selected number(s). The web-based dialing application may be 
configured to enable a user to dial one or more TCDs on different types of networks, 

25 including telephones on the PSTN and/or on a data network. Further, the web-based 

dialing application may define a call set-up HTML tag, e.g., "callto:<destination>", that 
operates similarly to the mailto:<destination> HTML tag, such that clicking the call set-up 
tag triggers the creation of a telephone call to the <destination>. 

An example web-based dialing application may define a method of initiating a 

30 telephone call between a first user of the first TCD and one or more second users of 

second TCDs, This method may include receiving one or more URL selections made by 
the first user, where each URL selection corresponds to one of the second TCDs. Next, a 
telephone call between the first TCD and the one or more second TCDs may be initiated, 

s 
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Such a web-based dialing application may use one or more network directories 
as described above in relation to Fig. 7, to map a user of TCD identifier, e.g.. URL 
telephone number, extension, to determine a network address for which to set-up a 
telephone call. Further, such a web-based dialing application may use other network 
5 resources. e.g.. an IP/PSTO gateway, to send a set-up message to a TCD located on 
another network, e.g., the PSTN, as described above in relation to Fig. 7. 

Another telephony application may be defined to display text on a display screen 
of a first TCD. where the content of the text corresponds to the content of an audio signal 
bemg received on the first TCD. For example, such a telephony application may be 
configured to display options on a display screen, e.g., display screen 206 corresponding 
to options played by an Interactive Voice Response (IVR) system. For example, such a 
telephony application may be configured to indicate to a second TCD (e g a TCD that is 
part of an IVR system) that the first TCD is capable of displaying text. In response, the 
second TCD may send, or control another resource to send, text content corresponding to 
15 the audio content to the first TCD. 

The first TCD then may display the text content, for example, a list of choices, on 
the display screen, as the IVR message is being played: A user may then make a 
selection using a user interface con-esponding to the display screen, e.g., the user 
interface described above in relation to Fig. 5, as opposed to waiting for the complete 
20 IVR message to be played on the first TCD. 

If the second TCD is part of an IVR system. e.g., a customer service network a 
central server may act as a proxy for the second TCD and other TCDs of the IVR system 
and may be the network resource that sends the text signal to the firet TCD. 

Fig. 12 is a flow chart illustrating an example method 500 of displaying text 
25 associated with media, e.g., audio or video, received on a first comiection between the 
first TCD and a second TCD as part of a telephone call, where the first TCD includes a 
display screen, for example, display screen 206 of Fig. 5. Such a method may be defined 
by one or more telephony applications. 

In Act 502, a media signal may be received on the first connection from the 
to second TCD, where the media signal represents media content. 

In Act 504, before or concurrently to receiving the media signal, a textual signal 
•s received on the first connection. The textual signal represents text content 
corresponding to the media content. 
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Next, in Act 506, the text content is displayed on the display screen. In a 
following Act 508, after or concurrently to displaying the text content, the media content 
may be played. 

Other applications may be defined to send textual data in response to a call set-up 
5 message. For example, such an application may be configured such that upon receiving 
a call set-up message from another TCD, the first TCD responds with a textual message, 
where the textual message depends on a state of the first TCD. For example, the first 
TCD may be defined to have a "not in office" state. Accordingly, the application may be 
configured such that when the first TCD receives a call set-up message, the first TCD 
10 sends a list of other contact methods to the other TCD, for example, a cell phone number, 
a voice mail address, or a telephone number of another user. 

Fig. 13 is a flow chart illustrating an example embodiment of a method 510 of 
communicating information in accordance with a state of the first TCD to a second TCD, 

In Act 5 12, a call set-up message is sent to the second TCD to set-up the 
15 telephone call. Next, in Act 514, in response to the call set-up message, a textual signal 
is received from the second telephony communication device. The textual signal defines 
text content corresponding to a state of the second TCD. 

In a following step 516, tlie text content is displayed on the display screen of the 
first TCD. 

20 The text content may include one or more options corresponding to the state of 

second TCD, where each option indicates an action to be taken in response to the state of 
the second TCD. These one or more options may be displayed to the user of the first 
TCD. Accordingly, the method 510 also may include an act of receiving a selection of 
one of the options firom the first user, and sending a selection signal representing this 
25 selection to the second TCD to perform the action indicated by the selection. 

Fig. 14 is a flow chart illustrating an example embodiment of a method 520 of 
communicating information in accordance with a state of the first TCD to a second TCD. 

In Act 522, a call set-up message to initiate a telephone call is received at the first 
TCD from the second TCD. Next, in Act 524, a state of the first TCD is determined. 
^0 a following step 526, the first TCD transmits a textual signal representing the 

determined state to the second TCD for display. 

As described above, the textual signal may include textual representations of one 
or more options for a user of the second TCD to be displayed on the second TCD. Each 
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option may indicate an action to be taken in response to the state of the first TCD 
Accordingly, the method 520 may further include an act of receiving a selection signal 
from the second TCD. where the selection signal represents a selection of the one or 
more options by the user of the second TCD. and an act of performing the action 
..mdicated by the selection. 

. Another application may define a method of communicating an audible 
expression during a telephone call on the commxmications network, where an audible 
expression is a sound that has meaning to a user. Such an audible expression may 
express an emotional state or provide emphasis during a phone call. For example an 
audible may be a sound of a bomb exploding, a popular expression, a bell gouging or 
another sound that would have meaning to a user. These sounds may be encoded Is part 
of the tone generator 69 or may be stored on a storage medium accessible by the first 
TCD, e.g., audio, storage medium 60. The application may be configured to mix the 
audxble expression and a user's voice on the first TCD such that another participant in a 
phone call will hear a mixed audible signal including the voice and the audible 
expression. Optionally, the audible expression can be mixed with a user's voice such 
that only the audible.expression is heard. . 

Video or textual expressions also may be used in a similar mamier to 
communicate during a telephone call. 

One or more applications may be defined to play and stop media on the first TCD 
as part of a game. For example, a "whack-a-mole" style game may be defined such that 
a media. e.g.. audio or video, plays on the first TCD until a user of the first TCD selects a 
particular key sequence or presses a particular button on the user interface of the first 
TCD. If a correct sequence is entered by the user within a set period of time, then the 
Playmg of the sound may be stopped and control of the game may be sent to anotiier 
TCD to continue the game. 

Further, an application may be configured such that a quote-of-lhe-day or fortune 
received on the TCD a, specified intervals, e.g.. daily, weekly, hourly, as configured 
by a user or a network provider. 

Other telephony applications may be defined to play text, media, or other 
information on the first TCD as part of an advertisement or as part of a screen saver U.at 
runs on a display screen of the first TCD. 
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Fig. 15 is a flow chart illustrating an example embodiment of a method 530 of 
communicating an audible expression during a telephone call. 

In Act 532, a voice signal representing a voice of a first user of the first TCD is 
received. In a next Act 534, a selection signal representing a selection of an audible 
5 expression by the first user is received. 

Next, in Act 536, the audible expression signal corresponding to the selection 
signal is generated, where the audible expression signal represents the audible 
expression. In a folio v/ing Act 538, the audible expression signal and the voice signal 
are mixed to produce a mixed signal. 

Next, in Act 540, the mixed signal is transmitted as part of the telephone call to 
one or more second users at one or more second TCDs. 

A call screening application may be defined to screen incoming calls to the first 
TCD based on data associated with the incoming call, for example, a caller identification 
(i.e., caller ID), the time of day, or other associated data. The screening application may 
define rules, or provide parameters by which a user may define rules, to determine how 
to respond to a call set-up message based on different criteria. For example, for a highly 
important call, the rules may be defined such that the first TCD tries a series of different 
phone numbers in an effort to contact a user of the first TCD. Further, the screening 
application may be defined such that, for less important calls, the first TCD may offer 
voicemail or other alternatives. Also, the screening application may be configured such 
that the caller may be queried to supply additional information before tlie call is filtered 
appropriately. 

Fig. 16 is a flow chart illustrating an example embodiment of a method 550 of 
screening a telephone call based on information associated v/ith the call. 

In Act 552, a first call set-up message is received at the first TCD from a second 
TCD. Next, in Act 554, one or more call answering rules are accessed, where each call 
answering rule defines a condition and an action to be taken by the first TCD in response 
to receiving a call set-up message if the condition is satisfied. 

In a following Act 556, for one or more of the call answering rules, it is 
determined whether the condition is satisfied. Next, in Act 558, the call set-up message 
is responded to in accordance with the determinations for the one or more call answering 
rules. 
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As described above, a fir^t rule of the one or more rules may define an action to 
be taken on condition of a call set-up message being received during one or more time 
intervals. Accordingly, the method 550 also may include acts of determining a first time 
at which the call set-up message is received, arid comparing the first time to the one or 
5 more time intervals to determine whether the first time is within one or more of the time 
intervals. If the first time is within one of the one or more time intervals, the act of 
responding to the call set-up message comprises responding to the call set-up message in 
accordance with the action defined by first the rule. 

Further, as described above, a first rule of the one or more rules may define an 
action to be taken on condition of the call set-up message being from a particular user. 
Accordingly, the act of receiving of method 550 may include receiving an identification 
signal corresponding to the call set-up message, where the identification signal identifies 
a user of the second communication device. Further, the act of determining may include 
identifying the user fi-om the identification signal, and comparing the identification of the 
user to identifications of one or more particular users to determine if the user is one of 
the particular users. If the user is one of the particular users, the act of responding to the 
call set-up message may comprise responding to the call set-up message in accordance 
with the action defined by the first rule. 

Further, one or more of the call answering rules may define forwarding the call 
set-up message to one or more other TCDs if a first condition is satisfied. Accordingly, 
the act of responding may include forwarding the call set-up message to the one or morl . 
other TCDs if the first condition is satisfied. 

Further, the screening application may be configured such that one of the call 
answering rules define playing a sound if a first condition is satisfied. Accordingly, the 
act of responding may include playing such sound if the first condition is satisfied. ' 

The screening application also may be configured such that one of the call 
answering rules defines prompting a user of a calling TCD for more information if a first 
condition is satisfied. Accordingly, the act of responding may include prompting the 
user for more information if the first condition is satisfied. 

Another application may be configured to integrate e-mail with a telephone call. • 
Fig. 1 7 is a flow chart illustrating an example embodiment of a method 560 of playing 
content of an e-mail message as audio on the first TCD. 
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In Act 562, the electronic e-mail message is controlled to be sent to a network 
resource that converts the textual content of the e-mail message to a voice signal. 
Optionally, the first TCD may inclu4e a text-to-speech application, such that the first 
TCD is the network resource. 
5 In the next Act 564, a call is set-up between the network resource and the first 

TCD. In a following step 566, the voice signal is controlled to be transmitted to the first 
TCD as part of the telephone call. This transmission may be controlled by the first TCD. 
Next, in Act 568, the voice signal is played on the first TCD. 
Another telephony application may be configured to record a telephone call 
10 conversation and then send the recorded conversation to one or more audio-playing 
devices, e.g., one or more other TCDs. For example, such a telephony application may 
define a method of communicating, to one or more second users of one or more second 
TCDs, at least a first part of a telephone call between a first user of the first TCD and one 
or more third users of one or more third TCDs. Such a method may comprise an act of 
1 5 recording as an audio file at least the first part of the telephone call between the-first user 
and the one or more third users, and sending the audio file to the one or more second 
TCDs. The audio file may be sent by attaching it to an e-mail message and sending the 
e-mail message to the one or more second TCDs, or by attaching the audio file to a call 
set-up message and sending the call set-up message to the one or more second TCDs. 

Another telephony application may define a method of sending a graphical file as 
a message for a user of a TCD. Fig. 1 8 is a flow chart illustrating an example method 
570 of sending a graphical message to a first user of a second TCD. 

In Act 572, a call set-up message is sent from the first TCD to the second TCD. 
Next, in Act 574, an indication is received firom the second TCD that the first user is not 
25 answering the call set-up message. 

In a following Act 576, a graphical file is sent from the first TCD to the second 
TCD to store as a message to the first user. The first user then may display the message 
on a display screen on the second TCD. Optionally, the second TCD may be configured 
such that only specific users can leave graphical messages on the second TCD. 
^0 F'8- 1 9 is a flow chart illustrating another example embodiment of a method 580 

of communicating a graphical message to a user of a first TCD, where the first TCD 
includes a display screen. 



20 
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In act 582, a call set-up message is received from a second TCD. In a following 
step 584, an indication that the first user is not answering the call set-up message is sent. 

Next, in act 586, in response to the sending of the indication, a graphical file is 
received fi-om the second TCD as a message. 
5 Next, in act 588, the graphical file is displayed on the display screen to 

communicate the message to the first user. 

Method 580 also may include an act of storing the graphical file on a storage 
medium accessible by the first TCD. for example, a local storage medium on the first 
TCD or another storage medium located on another network resource. 
10 Another telephony application may be configured to add a connection to a media 

source, for example, a media source on the Internet, and feed the media fiom that media 
source to another TCD that is put on hold by the first TCD. Such mfedia may be audio, 
video, or a combination thereof. 

Fig. 20 is a flow chart illustrating an example embodiment of a method 590 of 
5 placing one or more connections on hold during a telephone call. 

In Act 592, an instruction to place a telephone call on hold is received, and in Act 
594, an indication of a location of a media file is received. 

In Act 596, a connection to the location of the media file is created, and in Act 
598, media signals from the media file are received. 

0 . In a following step 600, the media signals are sent to the one or more connections 

on hold. 

Another telephony application may be defined such that personal information 
about a first user, including configuration information about how to configure a TCD for 
the fu-st user, and information about usage habits of the first user. 

5 Accordingly, when a first user uses any of a plurality of TCDs on the 

communication network, the first user may provide the first users identification and the 
personal information of the first user may be accessed and used to configure the TCD 
that the first user is using. Optionally, this personal information may be stored on a 
network resource accessible by any of the plurality of TCDs on the communications 

3 network. Further, a network resource, for example, the TCD deployment server 314 
described above in relation to Fig. 7, may be configured to retrieve the personal 
information for any of the TCDs on the communications network. 



BNSOOCID: <WO 01319aCIA2J_> 



WOoi/31900 ' ' PCT/USOO/29576 

-73- 

Fig. 21 is a flowchart illustrating an example embodiment of a method 610 of 
dynamically configuring a telephony communication device for a first user. 

In Act 612. a user identification identifying the first user may be received, and on 
Act 614, configuration information specific to the first user may be accessed. 
5 In a following Act 6 1 6, the TCD may be configured in accordance with the 

configuration information. 

Further, this personal information may be made available to callers whenever a 
call is made, or may be saved into and accessed from a personal information 
management application such as Microsoft Outlook® or Lotus Notes®, 
10 Also, select personal information may also be made available to a telephone call 

receiving IVR prompting. Accordingly, a telephone application may be configured such 
that, at each IVR prompt, the select personal infomiation may be accessed, and a 
response to the IVR prompt automatically sent, or, if a security feature is enabled, sent 
after permission is granted. 
15 Another telephony application may be configured to enable a TCD to distort, 

scramble or encrypt a media signal before sending the signeil onto the communications 
networks. 

Another telephony application may be configured to control the routing, of a 
telephone call through specific service providers on the communications network based 

20 on pre-defined criteria, for example, rates. Forexample, ifacall is tobeset-up witha 
TCD firom another network, such an application may be configured to query one or more 
IP/PSTN gateways or IP network-to-IP network service providers for rate information 
for 3uch a call. Such an application may include logic to determine the IP/PSTN 
gateway or service provider through which to set-up the telephone call based on the rate 

25 information. 

Another telephony application may be configured to provide hands-free call 
answering on a TCD, Such an application may be configured such that, when a call set- 
up message is received, an audible (e.g., ring) or visual signal (e.g., blinking light) 
indicates to the user that a call is incoming, the call is accepted, (i.e., a call is created on 
30 the TCD), and a speaker phone or other speaker is activated so that a user of the TCD 
instantly can begin a telephone conversation. 

Another telephony application may be configured to apply voice stress analysis to 
a telephone call. Such an application rnay monitor the emotional state of a speaker using 
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known techniques and assign an associated numerical stress level. The numerical stress 
level then may be displayed on a display screen to a user of the first TCD participating in 
the telephone call. 

Another telephony application may provide voice-based dialing on the first TCD 
5 Such an application may include voice recognition logic to search a database of voice 
patterns corresponding to users' network addresses or other identifiers to search for a 
match to a name spoken by a user of the first TCD. Such a database may be located 
locally on the first TCD or remotely on another network resource. After a pattern match 
IS made, the first TCD then automatically may set-up a call with the TCD corresponding 
• to the match. Such an application may provide a user of the first TCD with access to any 
telephone number available on the Internet or any other telephone director, accessible by 
the first TCD merely by speaking a name into the first TCD. 

As described above, a first TCD may store either locally or remotely telephone 
extensions and telephone numbers. Accordingly, a telephony application may be 
configured to search these numbers as a user is entering digits to call another user, and 
provide a list of numbers and extensions, or the names of users corresponding to the 
extensions and telephone numbers, on a display screen of the first TCD that match the 
digits entered so far by the user. The user then may select a telephone number extension 
or name fi-om the display screen using a user interface, as opposed to entering the entire 
number into the first TCD. As each new digit is entered by a user, the list of matching 
telephone numbers may be reduced, and this process may be repeated until the user 
makes a selection fi-om the list or the extension or telephone number is completely 
entered. 

As described above in relation to Figs. 5 and 6. another application may provide 
an on-demand help system on the first TCD. Such a help system may provide step-by- 
step information to a user of the first TCD about how to use the TCD and how to use 
particular applications. Such a help application may be configured to use media files to 
help a user. For example, if a user is dialing an international telephone number, the help 
system may prompt the user for the name of the country that is being dialed. In response 
to the user's entry forthe prompt, the help application may supply the associated counto' 
code and the expected digit length of the phone number. In another example, such a help 
application may provide a sequence of interactive text messages and audio clips that 
prompt a user through a new or infrequently used task. 
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A common problem in dialing a telephone number is incorrectly entering a digit, 
and having to hang up and redial the entire number. Accordingly, a telephony 
application may be configured to store all digits entered by a user locally before sending . 
a set-up message to initiate a telephone call. Further, such an application may display 
5 the digits on a display screen as the user is dialing. Thus, such an application may enable 
a user who enters an incorrect digit to merely clear the digit from the screen and re-enter 
the correct digit before the telephone call is initiated. After the correct number is 
entered, the user may be enabled to hit a button or touch a location on the display screen 
to initiate the telephone call. 

10 Another telephony application may be configured such that information about a 

user or TCD may be sent (e.g., attached) along with communication messages as part of 
a telephone call. Accordingly, such an application or a related application may be 
configured to extract such information from a communication message as part of a 
telephone call. Such information may include a local time at the caller's location or 

15 more sophisticated information such as a pointer to a web-based mapping application 

that visually shows the caller's location. Further, data representing the map itself may be 
sent along with a communication message. A variety of other forms of information may 
be sent along with a communication inessage as part of a telephone call. - 

Another telephony application may be configured to control a TCD to repetitively 

20 send a call set-up message to a network address at set intervals until the telephone call is 
answered by a human voice. Such an application may be used if a telephone call is too 
urgent to merely leave a voice message. Further, such an application may configure the 
first TCD to terminate, a telephone call if the recipient at the network address transfers 
the telephone call in response to the call set-up message. 

25 A space-saving application may define a method for loading only certain 

applications, portions of applications and data onto the first TCD in response to the TCD 
being initially deployed on a communications network. By configuring the first TCD to 
dynamically load only certain applications, portions of applications and data such a 
space-saving application limits the amount of memory consumed by applications on the 

30 first TCD, thereby conserving memory resources. This conserved memory then may be 
used for other purposes. 

Another application may be defined to provide a method of resolving conflicts 
between a plurality of applications on the first telephony communication device. For 
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example. two or more applications may be defined to be notified of a same event 
Accordingly, if the event occurs, a conflict occurs as to which application should be 
notified of the event. 

Accordingly, such an application may be defined to receive an indication that a 
5 first application and one or more second appUcations are defined to be notified if a first 
event occurs, and to assign notification priority to the first application such that if the 
first event does occur, the first application is notified of the event and the one or more 
second applications are not notified of the event. In other words, as described above in 
relation to tfxe application arbitrator, the first application consumes the notification to 
10 prevent fiiture conflicts with the one or more second applications. 

This conflict resolution application may include a user interface to allow a user to 
make the selection and assign notification priority to an application. For example the 
user mterface may be implemented on a desktop PC or on a telephone such as the 
telephone described in relation to Figs. 5 and 6. 
'5 Another application may be defined, for a telephone call including a first user of 

a first telephony communication device and a plurality of second users of other 
telephony communication devices, a method of visually indicating to tiie first user that 
the voices of one or more third users of the plurality of second users are currentiy being 
played on tiie first telephony communication device. 
20 The metiaod may include displaying a plurality of user identifiers, each user 

Identifier indicating one of ti.e second users. For example, these identifiers may be listed 
on a computer screen or on a display screen of a telephone, e.g., tf,e display screen 206 
• described above in relation to Figs. 5 and 6. 

Audio data may be received from one or more of ti,e second users on connections 
25 corresponding to the one or more second users, respectively. 

For each of the one or more third users, voice data may be detected in the audio 
data received from tiie ti^rd user using known DSP techniques. The application may 
configure one or more of the media processing elements described above in relation to 
the media processing module 29 to perform the known DSP techniques to detect if a 
30 voice is received on a connection. 

Next, the voice data of the third users may be mixed, for example, by the local 
bndge 51 of Fig. 3. to produce mixed audio data. In a following act, the mixed audio 
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data may be played on the first telephony communication device, for example, on a 
handset speaker, a headset speaker or base speaker. 

To indicate to the first user that the voices of the one or more third users are 
currently being heard by the first user, for each of the one or more third users, a visual 
5 indicatormay be displayed next to the identifier identifying the third user. For example, 
an icon may appear on the display screen next to the names of each second user for 
whom voice data v/as detected on the second user's connection. Other methods of 
indication may be used. 

The performance of the DSP, including receiving the audio data, detecting the 
10 voice data, and mixing the audio data may performed on a different device than the 
device that displays the indicators described above. For example, a first TCD may 
perform the DSP and a companion device may display the indicators, or a remote server 
may perform the DSP, and the first TCD may display the indicators. 

Further, a first device performing the DSP may communicate the voice detection, 
1 5 for example, as part of an RTCP message, to a second device that displays the indicators. 
Alternatively, the DSP and displaying may occur on a same device, for example, on the 
first TCD. 

Having now described some illustrative embodiments, it should be apparent to 
those skilled in the art that the foregoing is merely illustrative and not limiting, having 

20 been presented by way of example only. Nunierous modifications and other illustrative 
embodiments are within the scope of one of ordinary skill in the art and are contemplated 
as falling within the scope of the invention. In particular, although many of the examples 
presented herein involve specific combinations of method acts or apparatus elements, it 
should be understood that those acts and those elements may be combined in other ways 

25 to accomplish the same objectives. Acts, elements and features discussed only in 

connection with one embodiment are not intended to be excluded from a similar role in 
other embodiments. 
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I - A first telephony conmiunication device that is part of a communications network 
that comprises a transmission medium, the first telephony communication device 
comprising: 

5 a telephony hardware component comprising one or more inputs to 

receive audio input from a first user and first data from the transmission medium 
and one or more outputs to transmit media to the first user and second data to the 
transmission mediimi; and 

a telephony software component to control operation of the hardware 
component, the software component comprising at least a portion of a telephony 
application defining a telephony fiinction to be performed in association with a 
telephone call, 

wherein the telephony application is modifiable after the first telephony 
communication device is deployed on the communications network with 
modifications developed independently fi-om creation of the telephony software 
component 

2. The first telephony communication device of claim 1 . wherein the telephony 
software component fiirther comprises an open application programming interface to 
20 modify the telephony application. 

3 The first telephony communication device of claim 1. wherein the telephony 
software component fiirther comprises: 

at least a part of a non-telephony application defining a telephony 
function to be performed independently of a telephone call. 

4. The first telephony communication device of claim 1 , wherein at least a part of an 
additional telephony application can be added to the telephony software component after 
the first telephony communication device is deployed on the com^munications network. 

5. The first telephony communication device of claim 4, wherein the additional 
telephony application was developed independently from the vendor. 
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6 The first telephony communication device of claim 1 , wherein the telephony 
application is written in a general purpose programming language. 

7 The first telephony communication device of claim 1 , wherein the general 
5 purpose programming language is Java. 

8 The first telephony communication device of claim 1 , wherein the telephony 
software component further comprises: 

an operating system; and 
0 an operating system interface to interface communications between the operating 

system and the telephony applications of the telephony software component such that the 
telephony applications are independent of the operating system. 



9. The first telephony communication device of claim 1 , wherein the telephony 
15 software component further comprises: 

a call processing module to represent and control concurrently one or more 
telephone calls, each telephone call including one or more connections to other users 
corresponding to other telephony communication devices on the communicatiotis 
network, wherein, for each telephone call, the call processing module represents and 
20 controls each connection. 

1 0. The first telephony communication device of claim 9, 'wherein, for each 
connection, the call processing module is operative to control communications on the 
telephony device corresponding to the connection using a first call control protocol 

25 selectable from a plurality of call control protocols available on the first telephony 
communications device. 



1 1. The first telephony communication device of claim 10, wherein the telephony 
software component further comprises: 

an application programming interface to develop applications for the first 
telephony communication device, wherein the application programming interface is 
generic to the plurality of call control protocols. 
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12. The first telephony communication device of claim 9, wherein the telephony 
software component further comprises: 

a media processing module, the media processing module comprising, for each 
telephone call, a corresponding media processing component to represent media 
5 processing of the telephone call, and for each comiection of the telephone call, the media 
processing component includes a corresponding media processing connection. 

wherein, for each telephone call, to control the media processing of thi telephone 
call, the call processing module controls the media processing component corresponding 
to the telephone call, and. for each connection of the telephone call, to control the media 
processing of the connection, the call processing module controls the corresponding 
media processing connection. 

13. The first telephony communication device of claim 9, wherein the call processing 
module is operative to communicate with one or more other network resources on the 
communications network to control the one or more telephone calls. 

14. The first telephony communication device of claim 13, wherein a second 
telephony communication device is comiected to the communications network through a 
Public Switched Telephone Network and an IP/PSTN gateway, and 

wherein the call processing module is operative to communicate with the 
IP/PSTN gateway to control, during the telephone call, communications between the first 
user and a second user of the second telephony communication device. 

15. The first telephony communication device of claim 1. wherein the telephony 
25 software component fiirther comprises: 

a media processing module, the media processing module comprising media 
processmg elements to define media processing functions; 

wherein, to implement a media processing function, at least a first of the one or 
more telephony applications is operative to dynamically configure one or more 
combinations.of the media processing elements during execution of the first telephony 
application. 
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1 6. The first telephony communication device of claim 1 , wherein the telephony 
software component further comprises a pointer to a location on the communications 
network of an application remotely executable by the first telephony communication 
device. 

ft 

1 7. The first telephony communication device of claim 1 , wherein the telephony 
application defines a remote user interface for another network resource on the 
communications network. 

18. The first telephony conununication device of claim 1 , wherein the first telephony 
communication device is a telephone. 

19. A method of defining fiinctionality for a telephony communication device that is 
part of a communications network that comprises a transmission medium, the telephony 
communication device comprising a telephony hardware component comprising one or 
more inputs to receive audio input from a first user and first data firom the transmission 
medium, and one or more outputs to transmit media to the first user and second data to 
the transmission medium, and comprising a telephony software component to control 
operation of the hardware component, the software component comprising at least a 
portion a telephony application defining a telephony fiinction to be performed in 
association with a telephone call, the method comprising acts of: 

after the telephony communication device is deployed on the 
communications network, accessing the telephony application on the telephony 
communication device; and 

modifying the telephony applications with modifications developed 
independently from creation of the telephony software component. 

20. A system for defining functionality for a telephony communication device that is 
part of a communications network that comprises a transmission medium, the telephony 
communication device comprising a telephony hardware component comprising one or 
more inputs to receive audio input from a first user and first data from the transmission 
medium, and one or more outputs to transmit media to the first user and second data to 
the transmission medium, and comprising a telephony software component to control 
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operation of the hardware component, the software component comprising at least a 
portion a telephony application defining a telephony function to be performed in 
association with a telephone call, the system comprising: 

means for accessing the telephony application on the telephony 
5 communication device after the telephony communication device is deployed on 

the conununications network; and 

means for modifying the telephony application with modifications 
developed independently from creation of the telephony software component. 

10 21. A computer program product, comprising: 
a computer-readable medium; and 

computer-readable signals stored on the computer-readable medium that define 
instructions that, as a result of being executed by a computer, instruct the computer to 
perform a method of defining functionality for a telephony communication device that is 
part of a communications network that comprises a transmission medium, the telephony 
communication device comprising a telephony hardware component comprising one or 
more inputs to receive audio input firom a first user and first data from the transmission 
medium, and one or more outputs to transmit media to the first user and second data to 
the transmission medium, and comprising a telephony software component to control 
operation of the hardware component, the software component comprising at least a 
portion a telephony application defining a telephony fimction to be performed in 
association with a telephone call, the method comprising acts of: 

accessing the telephony application on the telephony communication 
device after the telephony communication device is deployed on the 
25 communications network; and 

modifying the telephony application with modifications developed 
independently from creation of the telephony software component. 

22. A communications network comprising: 
■^^ a transmission medium; and 

one or more telephony communication devices, each telephony 
communication device comprising 
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a telephony hardware component comprising one or more inputs 
to receive audio input from a first user and first data firom the transmission 
medium, and one or more outputs to transmit media to the first user and 
second data to the transmission medium; and 
5 a telephony software component to control operation of the 

hardware component, the software component comprising at least a 
portion a telephony application defining a telephony function to be 
performed in association with a telephone call, 

wherein the telephony application is modifiable after the 
10 telephony communication device is deployed on the communications 

network with modifications developed independently from creation of the 
telephony software component. 



23. A first telephony communication device that is part of a communications network 
15 that comprises a transmission medium, the first telephony communication device 

comprising: - 

a telephony hardware component comprising one or more inputs to 
receive audio input from a first user and first data from the transmission medium, 
and one or more outputs to transmit media to the first user and second data to the 
20 transmission medium; and 

a telephony software component to control operation of the hardware 
component, the software component comprising at least a portion a telephony 
application defining a telephony fijnction to be performed in association with a 
telephone call, 

25 wherein at least a part of an additional telephony application can be added 

to the telephony software component after the first telephony communication 
device is deployed on the communications network. 

24. The first telephony communication device of claim 23, wherein the additional 
30 telephony applications was developed independently from creation of the software 

component. 
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25. The first telephony communication device of claim 23. wherein the telephony 

software component further comprises an ODenaDnhcatmr,«r«« • - ^ 

f n upen appncation programmmg interface to add 

the at least part of the additional telephony application. 

5 26. The first telephony communication device of claim 23, wherein the telephony 
software component fiuther comprises: 

at least a part of a non-telephony application defining a non-telephony 
function to be performed independently of a telephone call. 

10 27. The first telephony communication device of claim 23, wherein the telephony 
application is modifiable after the first telephony communication device is deployed on 
the communications network with modifications developed independently from creation 
of the telephony software component. 

«5 28. The first telephony communication device of claim 23, wherein the telephony 
application is written in a general purpose programming language. 

29. The first telephony communication device of claim 23. wherein the 
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general 

purpose progranuning language is Java. 

30. The first telephony communication device of claim 23, wherein the telephony 
software component further comprises: 

an operating system; and 

an operating system interface to interface communications between the operating 
system and the telephony applications of the telephony software component such that the 
telephony applications are independem of the operating system. 

31 . The first telephony communication device of claim 23, wherein the telephony 
software component further comprises: 

a call processing module to represent and control concurrently one or more 
telephone-calls, each telephone call including one or more connections to other users 
corresponding to other telephony communication devices on the communications 
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network, wherein, for each telephone call, the call processing module represents and 
controls each connection. 

32. The first telephony communication device claim 31, wherein, for each 
5 connection, the call processing module is operative to control communications on the 
telephony device corresponding to the connection using a first call control protocol 
selectable from a plurality of call control protocols available on the first telephony 
communications device. 



10 



15 



33. The first telephoriy communication device of claim 32, wherein the telephony 
softwzire component fiirther comprises; 

an application programming interface to develop applications for the first 
telephony communication device, wherein the application programming interface is 
generic to the plurality of call control protocols. 



34. The first telephony communication device of claim 3 1 , wherein the telephony 
software component further comprises: 

a media processing module, the media processing module comprising, for each 
telephone call, a corresponding media processing, component to represent media 
20 processing of the telephone call, and for each connection of the telephone call, the media 
processing component includes a corresponding media processing connection, 

wherein, for each telephone call, to control the media processing of the telephone 
call, the call processing module controls the media processing component corresponding 
to the telephone call, and, for each connection of the telephone call, to control the media 
25 processing of the connection, the call processing module controls the corresponding 
media processing connection. 

35. The first telephony communication device of claim 31, wherein the call 
processing module is operative to communicate with one or more other network 

30 resources on the communications network to control the one or more telephone calls. 
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36. The first telephony communication device of claim 35, wherein a second 
telephony communication device is connected to the communications network through a 
Public Switched Telephone Network and an IP/PSTN gateway, and 

wherein the call processing module is operative to communicate with the 
IP/PSTN gateway to control, during the telephone call, communications between the first 
user and a second user of the second telephony communication device. 

37. The first telephony communication device of claim 23, wherein the telephony 
software component further comprises: 

a media processing module, the media processing module comprising media 
processing elements to define media processing functions; 

wherein, to implement a media processing function, the telephony application is 
operative to dynamically configure one of more combinations of the media processing 
elements during execution of the telephony application. 

38. The first telephony communication device of claim 23. wherein the telephony 
software component further comprises a pointer to a location on the communications 
network of an application remotely executable by the first telephony communication 
device. 

39. The first telephony communication device of claim 23, wherein the telephony 
application defines a remote user interface for another network resource on the 
commimications network. 

25 40. The first telephony communication device of claim 23, wherein the first 
telephony communication device is a telephone. 

41. A method of defining functionality for a telephony communication device that is 
part of a communications network that comprises a transmission medium, the telephony 
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communication device comprising a telephony hardware component comprising one or 
more inputs to receive audio input from a first user and first data from the transmission 
medium, and one or more outputs to transmit media to the first user and second data to 
the transmission medium, and comprising a telephony software component to control 
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operation of the hardware component, the software component comprising at least a 
portion a telephony application defining a telephony function to be performed in 
association with a telephone call, the method comprising acts of: 

after the telephony communication device is deployed on the 
5 communications network, accessing the telephony software component on the 

telephony coaununication device; and 

adding at least a part of an additional telephony application to the 
telephony software component. 

10 42. A system for defining functionality for a telephony communication device that is 
part of a conmiunications network that comprises a transmission medium, the telephony 
communication device comprising a telephony hardware component comprising one or 
more inputs to receive audio input from a first user and first data from the transmission 
medium, and one or more outputs to transmit media to the first user and second data to 

15 the transmission medium, and comprising a telephony software component to control 
operation of the hardware component, the software component comprising at least a 
portion a telephony application defining a telephony function to be performed in 
association with a telephone call, the system comprising: 

means for accessing the telephony software component after the 

20 telephony communication device is deployed on the communications network; 

and 

means for adding at least a part of an additional telephony application to 
the telephony software component. 

25 43. A computer program product, comprising: 
a computer-readable medium; and 

computer-readable signals stored on the computer-readable medium that define 
instructions that, as a result of being executed by a computer, instruct the computer to 
perform a method of defining functionality for a telephony communication device that is 
30 part of a communications network that comprises a transmission medium, the telephony 
communication device comprising a telephony hardware component comprising one or 
more inputs to receive audio input from a first user and first data from tlie transmission 
medium, and one or more outputs to transmit media to the first user and second data to 
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the transmission medium, and comprising a telephony software component to control 
operation of the hardware component, the software component comprising at least a 
portion a telephony application defining a telephony fimction to be perfonned in 
association with a telephone call, the method comprising acts of: 

accessing the telephony software component after the telephony 
communication device is deployed on the communications network; and 
adding at least a part of an additional telephony application to the 
telephony software component. 



10 44. 
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A commimications network comprising: 
a transmission medium; and 

one or more telephony communication devices, each telephony 
communication device comprising 

a telephony hardware component comprising one or more inputs 
to receive audio input from a first user and first data from the transmission 
medium, and one or more outputs to transmit media to the first user and 
second data to the transmission medium; and 

a telephony software component to control operation of the 
hardware component, the software component comprising at least a 
portion a telephony application defining a telephony fiinction to be 
performed in association with a telephone call, 

wherein at least a part of an additional telephone applications can 
be added to the telephony software component after the telephony 
communication device is deployed on the communications network. 



45. A telephony communication device that is part of a communications network that 
comprises a transmission medium, the telephony communication device comprising: 

a call processing module to represent and control at least a first telephone 
call that includes one or more connections to other users, each user corresporiding 
30 to another telephony communication device on the communications network. 

wherein, for at least a first of tlie one or more connections, the call 
processing module is operative to control communications corresponding to the 
first connection on the telephony communication device using a first call control 
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protocol selectable from a plurality of call control protocols available on the first 
telephony communication device, 

46. The telephony communication device of claim 45, wherein, concurrently tp 
5 controlling the communications corresponding to the first connection, the call 
processing module is operative to control communications on the telephony device 
corresponding to a second of the one or more connections using a second of the plurality 
of call control protocols. 

1 0 47. The telephony commimications device of claim 45, wherein the call processing 
module represents and controls a second telephone call that represents at least a second 
connection, 

wherein, concurrently to controlling communications corresponding to the first 
connection, the call processing module is operative to control communications 
15 corresponding to the second connection on the telephony communication device using a 
second of the plurality of call control protocols, 

48. The telephony conmiunication device of claim 45, wherein the first call control 
protocol is the Session Initiation Protocol. 

20. 

49. The telephony communication device of claim 45, wherein the first call control 
protocol is the first telephone call using the H.323 protocol. 

50. The telephony communication device of claim 45, wherein the first call control 
25 protocol is the Media Gateway Control Protocol. 

5 1 . The telephony communication device of claim 45, wherein the call processing 
module is operative to control one or more of the connections of the first telephone call 
using the Megaco/H.248 Protocol 



30 



52, The telephony communication device of claim 45, wherein the call processing 
module is operative to control one or more of the connections of the first telephone call 
using Ihe Skinny Station Protocol. 
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53. A method of controlling one or more telephone calls on a first telephony 
communication device connected to a communications network, a first telephone call 
including one or more connections to other users, each user corresponding to another 
telephony communication device on the communications network, the method 
comprising, for at least a first of the one or more connections, acts of: 

selecting a first call control protocol from a plurality of call control 
protocols available on the first telephony communication device; and 

controlling communications corresponding to the first connection on the 
telephony communication device using the first call control protocol. 

54. The method of claim 53, the method further comprising an act of: 
concurrently to controlling the communications corresponding to the first 

comiection. controlling communications on the telephony device corresponding 
to a second of the one or more connections using a second of the plurality of call 
control protocols,. 

55. The method of claim 53. wherein a second telephone call includes at least a 
second connection, the method fiuther comprising: 

concurrently to controlling communications corresponding to the first 
connection, controlling communications corresponding to the second connection 
on the telephony communication device using a second of the plurality of call 
control protocols. 

25 56. A system for controlling a first telephone call on a first telephony communication 
device comiected to a communications network, the telephone call including one or more 
connections to other users, each user corresponding to another telephony communication 
device on the communications network, the system comprising, for at least a fii^t of the 
one or more cormections: 
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means for selecting a first call control protocol from a plurality of call 
control protocols available on the first telephony communication device; and 
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means for controlling commuxiications corresponding to the first 
connection on the telephony communication device using the first call control 
protocol. 

5 57. A computer program product, comprising: 
a computer-readable medium; and 

computer-readable signals stored on the computer-readable medium that define 
instructions that, as a result of being executed by a computer, instruct the computer to 
peifomi a method of controlling a first telephone call on a first telephony comiriunication 
10 device connected to a communications network, the telephone call including one or more 
connections to other users, each user conresponding to another telephony communication 
device on the conununications network, the method comprising, for at least a first of the 
one or more connections, acts of: 

selecting a first call control protocol fi-om a plurality of call control 
15 protocols available on the first telephony communication device; and 

controlling communications corresponding to the first connection on the 
telephony communication device using the first call control protocol. 

58. A communications network comprising: 
20 a transmission medium; 

one or more telephony communication devices, each telephony 
communication device comprising 

a call processing module to represent and control at least a first 
telephone call that includes one or more connections to other users, each 
2^ user corresponding to another telephony communication device on the 

communications network, 

wherein, for at least a first of the one or more connections, the call 
processing module is operative lo control communications corresponding 
to the first connection on the telephony communication device using a 
3^ . first call control protocol selectable from a plurality of call control 

protocols available on the first telephony communication device. 
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59. A computer program product, comprising: 
a computer-readable mediiwi; and 

computer-readable signals stored on the computer-readable medium that define 
instructions that, as a result of being executed by a first telephony communication 
5 device, instruct the first telephony communication device to perform a telephony 

application, wherein at least a portion of the telephony application may be added to the 
first telephony communication device after the first telephony communication device has 
been deployed on a communications network. 

10 60. The computer program product of claim 59, wherein the telephony application 
defines a method of indicating an incoming call to at least a first user of a second 
telephony communication device, the method comprising acts of: 

receiving a dialing instruction corresponding to a network address of the second 
telephony communication device; 

identifying the first user fi-om the dialing instructions; 
selecting a sound to play based on the identification; and 
sending a call set-up message to the second telephony communication device at 
the network address, the call set-up message including information to cause the second 
telephony communication device to produce the selected sound. 

20 

61. The computer program product of claim 60, wherein the information includes a 
signal representing the selected sound. 

62. The computer program product of claim 60, wherein the information includes an 
25 instruction to play the selected sound. 

63. The computer program product of claim 60, wherein the information includes an 
instruction to play the selected sound from a particular location. 

30 64. The computer program product of claim 59, wherein the telephony application 
defines a method of selectively transmitting media during a conference call that includes 
a first user input for receiving media from the first user and two or more connections 
between the first telephony communication device and two or more second telephony 
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communication devices, respectively, each second telephony communication device 
corresponding to a second user, the method comprising acts of: 

receiving a user selection identifying one or more third users to exclude from 
receiving media from one or more fourth users, wherein each third and fourth user is 
5 either the first user or one of the second users, 

during the conference call, receiving one or more media inputs from one or more 
of the fourth users; and 

during the conference call, preventing the one or more third users from receiving 
any media produced from the one or more media inputs. 

10 

65. The computer program product of claim 64, wherein the first telephony 
conununication device further comprises a local call bridge, and first application 
performs the act of preventing using the local call bridge. 

15 66. The computer program product of claim 64, wherein the user selection is received 
from the first user. 

67. The computer program product of claim 64, wherein the user selection is received 
from one of the second users. 

20 

68. The computer program product of claim 59, wherein the telephony application 
defines a method of selectively transmitting media during a conference call that includes 
a first user input for receiving media from the first user and two or more connections 
between the first telephony communication device and two or more second telephony 

25 communication devices, respectively, each second telephony communication device 
corresponding to a second user, the method comprising acts of: 

receiving a user selection identifying one or more third users to include in 
receiving media from one or more fourth users, wherein each third and fourth user is 
either the first user or one of the second users, 

during the conference call, receiving one or more media inputs from one or more 
of the fourth users; and 

during the conference call, permitting the one or more third users to receive 
media produced from the one or more media inputs. 
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69. The computer program product of claim 68. The computer program product of 
claim 22, wherein the first telephony communication device further comprises a local 
call bridge, and first application perfomis the act of permitting using the local call 
5 bridge. 



70. The computer program product of claim 68. wherein the user selection is received 
from the first user. 
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71 . The computer program product of claim 68, wherein the user selection is received 
from one of the second users. 

72. The computer program product of claim 59. wherein the telephony application 
defines a method of communicating, as part of a telephone call, textual information from 

15 a first user of a first telephony communication device to a second user of a second 

telephony communication device comiected to the first telephony communication device 
by a first connection, wherein the furst telephony communication device comprises a 
display screen, the method comprising acts of: 

during the telephone call, receiving on the Gist connection from the second 
telephony communication device first textual data defining text; and 

displaying on tiie display screen the text defined by tiie texttial data. 

73. The computer program product of claim 59, wherein the telephony application 
defines a method of performing a telephone call between a first user of the first 
telephony communication device and one or more second users of second telephony 
communication devices, the method comprising acts of: 

receiving one or more user identifiers, each user identifier identifying one of the 
second users; 

receiving date and time information specifying a future date and time to conduct 
30 thecal!; 

storing the user identifiers and the data and time information; 

at the date and lime specified by the date and time infonnation. accessing the user 
identifiers; and 



25 
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initiating a telephone call between the first telephony communication device and 
the one or more second telephony communication devices. 

74. The computer program product of claim 73, wherein the act of receiving 

5 comprises receiving two or more user identifiers, and wherein the act of initiating 

comprises initiating a conference call between the first telephony communication device 
and two or more second telephony commimication devices. 

75. The computer program product of claim 74, further comprising and act of: 
10 receiving a conference bridge identifier identifying a conference bridge, 

wherein the act of initiating the telephone call includes calling the conference 

bridge. 

76. The computer program product of claim 73, further comprising: 

15 before initiating the telephone call, notifying the one or more second users about 

the telephone call by sending a message including information about the telephone call 
from the first telephony communication device to the one or more second telephony 
communication devices. 

77. The computer program product of claim 59, wherein the telephony application 
defines a method of initiating a telephone call between a first user of the first telephony 
commimication device and one or more second users of second telephony 
commimication devices, the method comprising acts of: 

receiving one or more uniform resource locator selections made by the first user, 
each uniform resource locator selection corresponding to one of the second telephony 
communication devices; and 

initiating, from the first telephony communication device, a telephone call 
between the first telephony communication device and the one or more second telephony 
communication devices. 

78. The computer program product of claim 77, wherein the first application includes 
a web page defined on the first telephony communication device, and the method further 
comprising acts of: 
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receiving one or more user tag selections, each tag selection indicating a tag 
selected using a web browser from the web page; and 

determining the one or more uniform resource locators from the one or more 
selected tags. 

5 

79. The computer program product of claim 77, wherein the first telephony 
communication device includes an embedded web server, and the method further 
comprising acts of: 

providing the first user access to the web server after the first telephony 
communication device has been deployed on the communications network; 

receiving instructions from the first user entered through the web server; and 
creating the web page from the instructions. 
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80. The computer program product of claim 59. wherein the telephony application 
defines a method of displaying text associated with media received on a first comaection 
between the first telephony communication device and a second telephony 
communication device as part of a telephone call, and wherein the first telephony 
communication device fiarther comprises a display screen, the method comprising acts 



of: 



receiving on the first comiection a media signal from the second telephony 
communication device, the media signal representing media content; 

before or concurrently to receiving the media signal, receiving on the first 
comiection a textual signal representing text content corresponding to the media content; 

displaying the text content on the display screen; and 

after or concurrenUy to displaying the text content, playing the media contem. 



81. 



The computer program product of claim 80, wherein the textual signal is received 
m response to sending an indication to the second telephony communication device that 
the first telephony communication device is capable of displaying textual data 
30 corresponding to a telephone call. 

82. The computer program product of claim 80. wherein the media content comprises 
a voice produced by an interactive voice response system, the voice speaking one or 
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more options, and wherein the textual content textually represents the one of more 
options. 

-83. The computer program product of claim 59, wherein the telephony application 
5 defines a method of conununicating information in accordance with a state of a second 
telephony communication device, wherein the first further comprises a display screen, 
the method comprising acts of: 

sending a call set-up message to the second telephony conxmunication device to 
set-up the telephone call; 
1^^ in response to the call set-up message, receiving a textual signal from the second 

telephony communication device, the textual signal defining text content corresponding 
to a state of the second telephony communication device; and 

displaying the text content on the display screen of the first telephony 
communication device, 

15 

84. The computer program product of claim 83, wherein the text content comprises 
one or more options corresponding to the state of the second telephony communication 
device, each option indicating an action to be taken in response to the state of the second 
communication device, and wherem displaying the text content comprises displaying the 
20 one or more options to the user, the method further comprising acts of; 

receiving a selection of a first of the one or more options from the user; and 
sending a selection signal representing the selection to the second communication 
device to perform the action indicated by the selection. 

25 85, The computer program product of claim 59, wherein the telephony application 
defines a method of communicating information in accordance with a state of the first 
telephony communication device to a second telephony communication device, the 
method comprising acts of: 

receiving, at the first telephony communication device, a call set-up message 
30 from the second telephony communication device to initiate a telephone call; 

determining a state of the first telephony communication device; and 
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transmitting a textual signal representing the determined state from the first 
telephony communication device to the second telephony communication device for 
display. 



86. The computer program product of claim 85. wherein the textual signal comprises 
textual representations of one or more options for a user of the second telephony 
communication device to be displayed on the second telephony communication device 
each option indicating an action to be taken in response to the state of the second 
communication device, the method further comprising acts of: 

receiving a selection signal from the second communication device, the selection 
signal representing a selection of one of the options by a user to the second 
communication device; and 

performing the action indicated by the selection. 



10 



15 87. The computer program product of claim 59. wherein the telephony application 
defines a method of communicating an audible expression during a telephone call, the 
method comprising acts of; 

receiving a voice signal representing a voice of a first user of the first telephony 
communication device; 

20 receiving a selection signal representing a selection of an audible expression by 

the first user; 

generating tiie audible expression signal corresponding to flie selection signal, the 
audible expression signal representing the audible expression; ' • 

mixing the audible expression signal and the voice signal to produce a mixed 

25 signal; 

transmitting the mixed signal, as part of the telephone call, to one or more second 
users at one or more second telephony communication devices. 

88. The computer program product of claim 87, wherein, the first telephony 
30 communication device further comprises a display screen, and the method further 
comprises an act of: 

displaying one or more icons on the display screen, each icon representing an 
audible expression. 
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wherein the selection signal is produced by the first user selecting an icon from 
the display screen. 

89. The computer program product of claim 59, wherein the telephony application 

5 defines a method of screening a telephone call based on information associated with the 
call, the method comprising acts of: 

receiving at the first telephony communication device a first call set-up message 
from a second telephony communication device; 

accessing one or more call answering rules, each call answering rule defining a 
10 condition and an action to be taken by the first telephony communication device in 
response to receiving a call set-up message if the condition is satisfied; 

for one or more of the call answering rules, determining whether the condition is 
satisfied; and 

responding to the call set-up message in accordance with the determinations for 
15 the one or more call answering rules. 

90. The computer program product of claim 89, wherein a first of the one or more 
rules defines an action to be taken on condition of a call set-up message being received 
during one or more time intervals, 

20 wherein the act of determining comprises 

determining a first time at which the first call set-up is received; and 
comparing the first time to the one or more time intervals to determine 
whether the first time is within one or more of the time intervals; and 
wherein, if the first time is within the one or more time intervals, the act of 
25 responding to the call set-up message comprises responding to the call set-up message in 
accordance with the action defined by the first rule. 

91 . The computer program product of claim 89, a first of the one or more rules 
defines an action to be taken on condition of the call set-up message being from one or 

30 more particular users, 

wherein the act of receiving comprises receiving an identification signal 
corresponding to the call set-up message, the identification signal identifying a first user 
of the second communication device; 
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wherein the act of determining comprises 

identifying the first user from the identification signal; and 
comparing the identification of the first user to identifications of one or 

more particular users to determine if the first user is one of the particular users, 
5 and 

wherein, if the first user is one of the particular users, the act of responding to the 
call set-up message comprises responding to the call set-up message in accordance with 
the action defined by the first rule. 

10 92. The computer program product of claim 89. wherein a first rule of the one or 
more call answering rules defines forwarding the call set-up message to another first 
telephony communication device if a first condition is satisfied, 

wherein the act of responding comprises forwarding the call set-up message to 
the other first telephony communication device if the first condition is satisfied. 

IS 

93. The first telephony communication device of 89, wherein a first call answering 
rule defines playing a sound if a first condition is satisfied, 

wherein the act of responding comprises playing the sound if the first condition is 



20 



satisfied. 



94. The computer program product of claim 85, wherein a first call answering rule 
defines prompting a user of the second telephony communication device for more 
information if a first condition is satisfied, 

wherein the act of responding comprises prompting the user for more information 
25 if the first condition is satisfied. 



30 



95. The computer program product of claim 59. wherein the telephony application 
defines a method of playing textual content of an e-mail message as audio on the first 
telephony communication device, the method comprising acts of: 

controlling the electronic email message text to be sent to a network resource that 
converts the textual content of the e-mail message to a voice signal; 

setting up a telephone call between the network resource and the first telephony 
communication device; 
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controlling transmitting the voice signal to the first telephony communication 
device as part of the telephone call; £md 

playing the voice signal on the first telephony communication device. 

96. The computer program product of claim 59, wherein the telephony application 
defines a method of communicating, to a second user of at least a first part of a telephone 
call betv^een a first user of the first telephony communication device and one or more 
third users of one or more third first telephony communication devices, the method 
comprising acts of: 

recording as an audio file at least the first part of the telephone call between the 
first user and the one or more third users; 

sending the audio file to an audio playing device corresponding to the second 

user. 



15 97. The computer program product of claim 96, wherein the.act of sending comprises 
attaching the audio file to an e-mail message and sending an e-mail message to the audio 
playing device. 

98. The computer program product of claim 96, wherein the act of sending 

20 comprises attaching the audio file to a call set-up message and sending the call set-up 
message to the one or more second telephony communication devices. 

99. The computer program product of claim 59, wherein the telephony application 
defines a method of sending a graphical message to a first user of a second telephony 

25 communication device, the method comprising: 

sending a call set-up message from the first telephony communication device to 
the second telephony communication device; 

receiving an indication that the first user is not answering the call set-up message; 

and 

30 sending a graphical file to the second telephony communication device to store as 

a message to the first user. 
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100. The computer program product of claim 59. wherein the telephony application 
defines a method of communicating a graphical message to a first user of the first 
telephony communication device, wherein the first telephony communication device 
includes a display screen, the method comprising: 
5 receiving a call set-up message fi-om a second telephony communication; 

sending an indication that the first user is not answering the call set-up message; 

in response to the sending of the indication, receiving as a message a graphical ' 
file fi-om the second telephony communication device; and 

displaying the graphical file on the display screen to communicate the message to 
1 0 the first user to store as a message to the first user. 

101. The computer program product of claim 100. wherein the method further 
comprises an act of: 

storing the graphical file on a storage medium accessible by the first telephony 
1 5 communication device. 

1 02. The computer program product of claim 5.9. wherein the telephony application 
defines a method of placing one or more comiections on hold during a telephone call, 
the method comprising acts of: 

receiving an instruction to place a telephone call on hold; 

receiving an indication of a location of a media file; 
creating a connection to the location of the media file; 
receiving media signals fi-om the media file; and 
sending the media signals to the one or more connections on hold. 

103. The computer program product of claim 102, wherein the media file comprises 
audio data to be played at the one or more connections. 

104. The computer program product of claim 102. wherein the media file comprises 
text data, graphical data or a combination thereof, and the act of playing comprises 
displaying the text data, graphical data or combination thereof on a display screen under 
control of the first telephony communication device. 
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105. The computer program product of claim 59, wherein the application defines a 
method of dynamically configuring a first telephony communication device for a first 
user, the method comprising acts of: 

receiving a user identification identifying the first user; 
5 accessing configuration information specific to the first user; and 

configuring the first telephony communication device in accordance with the 
configuration information. 

106. The computer program product of claim 59, wherein the telephony application 
10 defines a method of resolving conflicts between a plurality of applications on the first 

telephony communications device, the method comprising: 

receiving an indication that a first application and one or moire second 

applications are defined to be notified if a first event occurs; and 

assigning notification priority to the first application such that, if first the event 
15 occurs, the first application is notified of the event and one or more second applications 

are riot notified of the event. 

107. The computer program product of claim 106, wherein the method further 
comprises acts of: 

20 receiving an instruction firom a user to assign notification priority to the first 

application, wherein the act of assigning is performed in response to receiving the 
instruction. 

108. The computer program product of claim 59, wherein the telephony application 
25 defines, for a telephone call including a first user of the first telephony communication 

device and a plurality of second users of other telephony communication devices, a 
method of visually indicating to the first user that the voices of one or more third users of 
the plurality of second users are currently being played on the first telephony 
communication device, the method comprising: 
30 displaying a plurality of user identifiers, each user identifier indicating one of the 

second users; 

receiving audio data from one or more of the second users; 
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for each of the one or more third users, detecting voice data in the audio data 
received from the third user; 

mixing the audio data of the third user to produce mixed audio data; 

playing the mixed audio data on the first telephony, communication device; and 
5 for each of the one or more third user^, displaying a visual indicator next to the 

identifier identifying the third user to indicate that the mixed audio data includes voice 
data from the third user. 

109. A first telephony communication device, comprising: 
^0 a computer-readable medium; and 

computer-readable signals stored on the computer-readable medium that define 
instructions that, as a result of being executed by a first telephony communication 
device, instmct the first telephony communication device to perform a telephony 
application, wherein at least a portion of the telephony application may be modified after 
the first telephony communication device has been deployed on a communications 
network with modifications developed independentiy from creation of the telephony 
application. 
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